[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1424 - Failure

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1424 - Failure

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1424/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No registered leader was found, collection:collection1 slice:shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
        at __randomizedtesting.SeedInfo.seed([66CF0506B635035C:E7298B1EC16A6360]:0)
        at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:484)
        at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:291)
        at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)


REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:


Stack Trace:
java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([66CF0506B635035C:E7298B1EC16A6360]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8462 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T48 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 9 T48 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363370065580
[junit4:junit4]   2> 20 T48 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 28 T49 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 97 T49 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 98 T49 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 98 T49 oaz.Environment.logEnv Server environment:java.version=1.6.0_32
[junit4:junit4]   2> 98 T49 oaz.Environment.logEnv Server environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 99 T49 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 99 T49 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 101 T49 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 101 T49 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 101 T49 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 101 T49 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4]   2> 102 T49 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 102 T49 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 102 T49 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4]   2> 102 T49 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4]   2> 103 T49 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 144 T49 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 145 T49 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 145 T49 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 150 T49 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 225 T49 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363370065579/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 230 T48 oasc.ZkTestServer.run start zk server on port:23429
[junit4:junit4]   2> 370 T48 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 371 T48 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 371 T48 oaz.Environment.logEnv Client environment:java.version=1.6.0_32
[junit4:junit4]   2> 372 T48 oaz.Environment.logEnv Client environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 372 T48 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 373 T48 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 375 T48 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 376 T48 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 376 T48 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 377 T48 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4]   2> 377 T48 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 378 T48 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 378 T48 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4]   2> 379 T48 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4]   2> 379 T48 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 385 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@61181c24
[junit4:junit4]   2> 508 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 516 T54 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 519 T54 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 519 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:11514
[junit4:junit4]   2> 553 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:11514
[junit4:junit4]   2> 568 T52 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 620 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60000 with negotiated timeout 10000 for client /140.211.11.196:11514
[junit4:junit4]   2> 620 T54 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60000, negotiated timeout = 10000
[junit4:junit4]   2> 626 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61181c24 name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 627 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 628 T48 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 711 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60000
[junit4:junit4]   2> 712 T55 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 713 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:11514 which had sessionid 0x13d6f303fc60000
[junit4:junit4]   2> 712 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60000 closed
[junit4:junit4]   2> 714 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@31955dd4
[junit4:junit4]   2> 715 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 716 T56 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 717 T56 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 717 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64680
[junit4:junit4]   2> 717 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64680
[junit4:junit4]   2> 719 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60001 with negotiated timeout 10000 for client /140.211.11.196:64680
[junit4:junit4]   2> 719 T56 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60001, negotiated timeout = 10000
[junit4:junit4]   2> 720 T57 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31955dd4 name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 720 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 721 T48 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 727 T48 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 739 T48 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 747 T48 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 757 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 788 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 803 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 807 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 914 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 915 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 921 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 922 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 927 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 929 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 934 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 936 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 941 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 943 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 949 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 951 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 957 T48 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 958 T48 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 963 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60001
[junit4:junit4]   2> 965 T57 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 965 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60001 closed
[junit4:junit4]   2> 965 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:64680 which had sessionid 0x13d6f303fc60001
[junit4:junit4]   2> 1220 T48 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1226 T48 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30354
[junit4:junit4]   2> 1227 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1227 T48 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1228 T48 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536
[junit4:junit4]   2> 1230 T48 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/solr.xml
[junit4:junit4]   2> 1232 T48 oasc.CoreContainer.<init> New CoreContainer 1300425896
[junit4:junit4]   2> 1234 T48 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/'
[junit4:junit4]   2> 1235 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/'
[junit4:junit4]   2> 1362 T48 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1364 T48 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1365 T48 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1366 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1367 T48 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1368 T48 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1369 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1370 T48 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1371 T48 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1373 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1495 T48 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1518 T48 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23429/solr
[junit4:junit4]   2> 1549 T48 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1550 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6d13722b
[junit4:junit4]   2> 1551 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1552 T67 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1553 T67 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 1553 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34732
[junit4:junit4]   2> 1554 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34732
[junit4:junit4]   2> 1557 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60002 with negotiated timeout 20000 for client /140.211.11.196:34732
[junit4:junit4]   2> 1557 T67 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60002, negotiated timeout = 20000
[junit4:junit4]   2> 1558 T68 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d13722b name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1559 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1563 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60002
[junit4:junit4]   2> 1564 T68 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1564 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60002 closed
[junit4:junit4]   2> 1564 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:34732 which had sessionid 0x13d6f303fc60002
[junit4:junit4]   2> 1575 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1589 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@425138a4
[junit4:junit4]   2> 1590 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1590 T69 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1591 T69 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 1591 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52415
[junit4:junit4]   2> 1592 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52415
[junit4:junit4]   2> 1595 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60003 with negotiated timeout 20000 for client /140.211.11.196:52415
[junit4:junit4]   2> 1595 T69 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60003, negotiated timeout = 20000
[junit4:junit4]   2> 1596 T70 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@425138a4 name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1596 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1612 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1623 T48 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1627 T48 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30354_
[junit4:junit4]   2> 1633 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:30354_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:30354_
[junit4:junit4]   2> 1634 T48 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30354_
[junit4:junit4]   2> 1641 T48 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1666 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1668 T48 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1672 T48 oasc.Overseer.start Overseer (id=89349820636332035-127.0.0.1:30354_-n_0000000000) starting
[junit4:junit4]   2> 1672 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1691 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1693 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1695 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1704 T72 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 1705 T48 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1709 T48 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 1719 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 1743 T71 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1756 T73 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/collection1
[junit4:junit4]   2> 1757 T73 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1758 T73 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1758 T73 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1761 T73 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/collection1/'
[junit4:junit4]   2> 1763 T73 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1763 T73 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/collection1/lib/README' to classloader
[junit4:junit4]   2> 1862 T73 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 1965 T73 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2067 T73 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2125 T73 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2923 T73 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2941 T73 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2946 T73 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2980 T73 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2988 T73 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2995 T73 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2997 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2997 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 2998 T73 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3000 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 3000 T73 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 3001 T73 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3001 T73 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363370066536/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data/
[junit4:junit4]   2> 3002 T73 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49198ff2
[junit4:junit4]   2> 3003 T73 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3004 T73 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data forceNew: false
[junit4:junit4]   2> 3004 T73 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data/index/
[junit4:junit4]   2> 3005 T73 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3006 T73 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data/index forceNew: false
[junit4:junit4]   2> 3011 T73 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@578caee7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7baf1ad8)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3011 T73 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3083 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3084 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3086 T73 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3087 T73 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3088 T73 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3089 T73 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3090 T73 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3091 T73 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3092 T73 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3101 T73 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3109 T73 oass.SolrIndexSearcher.<init> Opening Searcher@7488485f main
[junit4:junit4]   2> 3110 T73 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/control/data/tlog
[junit4:junit4]   2> 3111 T73 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3111 T73 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3118 T74 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7488485f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3122 T73 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3123 T73 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3124 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 3251 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3252 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:30354_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:30354"}
[junit4:junit4]   2> 3253 T71 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 3282 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3284 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 3349 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4145 T73 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4145 T73 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30354 collection:control_collection shard:shard1
[junit4:junit4]   2> 4157 T73 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 4183 T73 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 4203 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 4205 T73 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4206 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4215 T73 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4215 T73 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4221 T73 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30354/collection1/
[junit4:junit4]   2> 4221 T73 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 4222 T73 oasc.SyncStrategy.syncToMe http://127.0.0.1:30354/collection1/ has no replicas
[junit4:junit4]   2> 4222 T73 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30354/collection1/
[junit4:junit4]   2> 4223 T73 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 4230 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4859 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 4917 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4953 T73 oasc.ZkController.register We are http://127.0.0.1:30354/collection1/ and leader is http://127.0.0.1:30354/collection1/
[junit4:junit4]   2> 4953 T73 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30354
[junit4:junit4]   2> 4954 T73 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4954 T73 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4954 T73 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4958 T73 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 4960 T48 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 4961 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4962 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4975 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 4981 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19f71b53
[junit4:junit4]   2> 4983 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4983 T76 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4984 T76 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 4984 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32576
[junit4:junit4]   2> 4985 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32576
[junit4:junit4]   2> 4987 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60004 with negotiated timeout 10000 for client /140.211.11.196:32576
[junit4:junit4]   2> 4987 T76 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60004, negotiated timeout = 10000
[junit4:junit4]   2> 4988 T77 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19f71b53 name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4988 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4991 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 4997 T48 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 5194 T48 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 5198 T48 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45822
[junit4:junit4]   2> 5199 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 5200 T48 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5200 T48 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568
[junit4:junit4]   2> 5201 T48 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/solr.xml
[junit4:junit4]   2> 5201 T48 oasc.CoreContainer.<init> New CoreContainer 1431726510
[junit4:junit4]   2> 5202 T48 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/'
[junit4:junit4]   2> 5203 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/'
[junit4:junit4]   2> 5258 T48 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 5259 T48 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5259 T48 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 5260 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5261 T48 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5261 T48 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5262 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5262 T48 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5263 T48 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5264 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 5290 T48 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5313 T48 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23429/solr
[junit4:junit4]   2> 5314 T48 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5315 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@24d3e83f
[junit4:junit4]   2> 5316 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5316 T87 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5318 T87 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 5318 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25035
[junit4:junit4]   2> 5319 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25035
[junit4:junit4]   2> 5320 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60005 with negotiated timeout 20000 for client /140.211.11.196:25035
[junit4:junit4]   2> 5321 T87 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60005, negotiated timeout = 20000
[junit4:junit4]   2> 5321 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24d3e83f name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5322 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5324 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60005
[junit4:junit4]   2> 5325 T88 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5325 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60005 closed
[junit4:junit4]   2> 5325 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:25035 which had sessionid 0x13d6f303fc60005
[junit4:junit4]   2> 5326 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 5337 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@346fe350
[junit4:junit4]   2> 5339 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5339 T89 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5340 T89 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 5340 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:33306
[junit4:junit4]   2> 5341 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:33306
[junit4:junit4]   2> 5343 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60006 with negotiated timeout 20000 for client /140.211.11.196:33306
[junit4:junit4]   2> 5343 T89 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60006, negotiated timeout = 20000
[junit4:junit4]   2> 5343 T90 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@346fe350 name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5344 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5345 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5347 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5352 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 6358 T48 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45822_
[junit4:junit4]   2> 6359 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:45822_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:45822_
[junit4:junit4]   2> 6361 T48 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45822_
[junit4:junit4]   2> 6366 T77 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6366 T90 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6366 T70 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6367 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6381 T91 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/collection1
[junit4:junit4]   2> 6382 T91 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6383 T91 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6383 T91 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6385 T91 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/collection1/'
[junit4:junit4]   2> 6387 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6388 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/collection1/lib/README' to classloader
[junit4:junit4]   2> 6428 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 6430 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:30354_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:30354"}
[junit4:junit4]   2> 6443 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6443 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6443 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6449 T91 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 6519 T91 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6620 T91 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6658 T91 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7404 T91 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7423 T91 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7428 T91 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7467 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7475 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7482 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7484 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 7484 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 7485 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7487 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 7487 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 7488 T91 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7488 T91 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363370070568/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1/
[junit4:junit4]   2> 7488 T91 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49198ff2
[junit4:junit4]   2> 7489 T91 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7490 T91 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1 forceNew: false
[junit4:junit4]   2> 7491 T91 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1/index/
[junit4:junit4]   2> 7491 T91 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7492 T91 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1/index forceNew: false
[junit4:junit4]   2> 7495 T91 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7495 T91 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7499 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7500 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7501 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7502 T91 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7503 T91 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7504 T91 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7504 T91 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7506 T91 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7506 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7514 T91 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7521 T91 oass.SolrIndexSearcher.<init> Opening Searcher@3e9f26c7 main
[junit4:junit4]   2> 7521 T91 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty1/tlog
[junit4:junit4]   2> 7522 T91 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7523 T91 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7531 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e9f26c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7537 T91 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7537 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7952 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 7953 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:45822_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:45822"}
[junit4:junit4]   2> 7954 T71 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 7954 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7962 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7962 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7962 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8566 T91 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 8566 T91 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45822 collection:collection1 shard:shard1
[junit4:junit4]   2> 8568 T91 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 8594 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 8595 T91 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 8596 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8606 T91 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 8607 T91 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 8607 T91 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 8607 T91 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 8608 T91 oasc.SyncStrategy.syncToMe http://127.0.0.1:45822/collection1/ has no replicas
[junit4:junit4]   2> 8608 T91 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 8609 T91 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 8615 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9469 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 9518 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9518 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9518 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9542 T91 oasc.ZkController.register We are http://127.0.0.1:45822/collection1/ and leader is http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 9542 T91 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45822
[junit4:junit4]   2> 9542 T91 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 9543 T91 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9543 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9546 T91 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 9547 T48 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9548 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9549 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9693 T48 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9695 T48 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55409
[junit4:junit4]   2> 9696 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9696 T48 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9697 T48 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130
[junit4:junit4]   2> 9697 T48 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/solr.xml
[junit4:junit4]   2> 9698 T48 oasc.CoreContainer.<init> New CoreContainer 1178078326
[junit4:junit4]   2> 9698 T48 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/'
[junit4:junit4]   2> 9698 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/'
[junit4:junit4]   2> 9736 T48 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 9737 T48 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9737 T48 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9738 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9738 T48 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9738 T48 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9739 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9739 T48 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9739 T48 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9740 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9756 T48 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9772 T48 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23429/solr
[junit4:junit4]   2> 9773 T48 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9773 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2176feaf
[junit4:junit4]   2> 9774 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9774 T103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9775 T103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 9776 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:11371
[junit4:junit4]   2> 9776 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:11371
[junit4:junit4]   2> 9779 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60007 with negotiated timeout 20000 for client /140.211.11.196:11371
[junit4:junit4]   2> 9779 T103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60007, negotiated timeout = 20000
[junit4:junit4]   2> 9779 T104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2176feaf name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9780 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9781 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60007
[junit4:junit4]   2> 9797 T104 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9797 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60007 closed
[junit4:junit4]   2> 9797 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:11371 which had sessionid 0x13d6f303fc60007
[junit4:junit4]   2> 9798 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 9807 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@c596a7a
[junit4:junit4]   2> 9809 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9809 T105 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9810 T105 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 9810 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40871
[junit4:junit4]   2> 9811 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40871
[junit4:junit4]   2> 9813 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60008 with negotiated timeout 20000 for client /140.211.11.196:40871
[junit4:junit4]   2> 9813 T105 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60008, negotiated timeout = 20000
[junit4:junit4]   2> 9813 T106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c596a7a name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9814 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9815 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9817 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9820 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 10825 T48 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55409_
[junit4:junit4]   2> 10826 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc60008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55409_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55409_
[junit4:junit4]   2> 10835 T48 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55409_
[junit4:junit4]   2> 10846 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10846 T106 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10847 T70 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10847 T77 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10847 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10847 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10849 T90 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10856 T107 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/collection1
[junit4:junit4]   2> 10856 T107 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 10857 T107 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10858 T107 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 10859 T107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/collection1/'
[junit4:junit4]   2> 10860 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/collection1/lib/README' to classloader
[junit4:junit4]   2> 10861 T107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 10902 T107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 10953 T107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 11033 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11034 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:45822_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:45822"}
[junit4:junit4]   2> 11049 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11049 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11049 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11054 T107 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 11054 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11076 T107 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 11614 T107 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 11627 T107 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 11630 T107 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 11656 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11661 T107 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11667 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11669 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11669 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11669 T107 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11671 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11671 T107 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11672 T107 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 11672 T107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363370075130/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/
[junit4:junit4]   2> 11672 T107 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49198ff2
[junit4:junit4]   2> 11674 T107 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 11674 T107 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2 forceNew: false
[junit4:junit4]   2> 11674 T107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/index/
[junit4:junit4]   2> 11675 T107 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 11675 T107 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/index forceNew: false
[junit4:junit4]   2> 11677 T107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@34e6529c lockFactory=org.apache.lucene.store.NativeFSLockFactory@50e8709d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11678 T107 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11681 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 11681 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 11682 T107 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 11683 T107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 11684 T107 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 11684 T107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 11684 T107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 11685 T107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 11685 T107 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 11691 T107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 11696 T107 oass.SolrIndexSearcher.<init> Opening Searcher@55f713ed main
[junit4:junit4]   2> 11696 T107 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/tlog
[junit4:junit4]   2> 11697 T107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 11698 T107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 11703 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55f713ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11707 T107 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 11708 T107 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12557 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12558 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:55409_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:55409"}
[junit4:junit4]   2> 12559 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 12559 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 12576 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12576 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12576 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12576 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12714 T107 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 12714 T107 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55409 collection:collection1 shard:shard1
[junit4:junit4]   2> 12774 T107 oasc.ZkController.register We are http://127.0.0.1:55409/collection1/ and leader is http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 12775 T107 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55409
[junit4:junit4]   2> 12775 T107 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 12776 T107 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@1361c602 url=http://127.0.0.1:55409/collection1 node=127.0.0.1:55409_ C1_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:55409_, base_url=http://127.0.0.1:55409}
[junit4:junit4]   2> 12782 T109 C1 P55409 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 12783 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12783 T107 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12783 T109 C1 P55409 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 12784 T109 C1 P55409 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12785 T48 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 12785 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12786 T109 C1 P55409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12786 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12939 T48 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12941 T48 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54823
[junit4:junit4]   2> 12942 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12942 T48 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12943 T48 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373
[junit4:junit4]   2> 12943 T48 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/solr.xml
[junit4:junit4]   2> 12943 T48 oasc.CoreContainer.<init> New CoreContainer 249628633
[junit4:junit4]   2> 12944 T48 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/'
[junit4:junit4]   2> 12944 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/'
[junit4:junit4]   2> 12981 T48 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12982 T48 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12982 T48 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12982 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12983 T48 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12983 T48 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12984 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12984 T48 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12984 T48 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12985 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 13001 T48 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 13016 T48 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23429/solr
[junit4:junit4]   2> 13017 T48 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 13017 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1efa9557
[junit4:junit4]   2> 13018 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13019 T120 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 13020 T120 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 13020 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:46161
[junit4:junit4]   2> 13020 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:46161
[junit4:junit4]   2> 13022 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc60009 with negotiated timeout 20000 for client /140.211.11.196:46161
[junit4:junit4]   2> 13023 T120 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc60009, negotiated timeout = 20000
[junit4:junit4]   2> 13023 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1efa9557 name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13023 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13025 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc60009
[junit4:junit4]   2> 13027 T121 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13027 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc60009 closed
[junit4:junit4]   2> 13027 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:46161 which had sessionid 0x13d6f303fc60009
[junit4:junit4]   2> 13028 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 13038 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@14bf711e
[junit4:junit4]   2> 13039 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13040 T122 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 13041 T122 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 13041 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35835
[junit4:junit4]   2> 13041 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35835
[junit4:junit4]   2> 13043 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc6000a with negotiated timeout 20000 for client /140.211.11.196:35835
[junit4:junit4]   2> 13043 T122 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc6000a, negotiated timeout = 20000
[junit4:junit4]   2> 13044 T123 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14bf711e name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13044 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13045 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13047 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13051 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 14055 T48 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54823_
[junit4:junit4]   2> 14057 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000a type:delete cxid:0xb zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54823_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54823_
[junit4:junit4]   2> 14077 T48 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54823_
[junit4:junit4]   2> 14080 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14081 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14081 T70 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14082 T77 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14082 T123 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14082 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14082 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14084 T106 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14094 T90 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 14096 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 14098 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:55409_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:55409"}
[junit4:junit4]   2> 14100 T124 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/collection1
[junit4:junit4]   2> 14100 T124 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14101 T124 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14101 T124 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14103 T124 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/collection1/'
[junit4:junit4]   2> 14105 T124 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14106 T124 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/collection1/lib/README' to classloader
[junit4:junit4]   2> 14172 T124 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 14176 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14176 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14176 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14176 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14176 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14243 T124 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14344 T124 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14365 T124 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14822 T80 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=3&state=recovering&nodeName=127.0.0.1:55409_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2006
[junit4:junit4]   2> 14920 T124 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14934 T124 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14937 T124 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14960 T124 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14965 T124 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14969 T124 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14971 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14971 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14971 T124 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14973 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14973 T124 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14973 T124 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14974 T124 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363370078373/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/
[junit4:junit4]   2> 14974 T124 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49198ff2
[junit4:junit4]   2> 14975 T124 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 14976 T124 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3 forceNew: false
[junit4:junit4]   2> 14976 T124 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/index/
[junit4:junit4]   2> 14977 T124 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14977 T124 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/index forceNew: false
[junit4:junit4]   2> 14979 T124 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d2fb7ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@236eacf1)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14979 T124 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14982 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14982 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14983 T124 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14984 T124 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14984 T124 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14985 T124 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14985 T124 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14986 T124 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14986 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14991 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14996 T124 oass.SolrIndexSearcher.<init> Opening Searcher@53e66f65 main
[junit4:junit4]   2> 14996 T124 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/tlog
[junit4:junit4]   2> 14997 T124 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14997 T124 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15002 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53e66f65 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15004 T124 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15004 T124 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15684 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 15686 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:54823_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:54823"}
[junit4:junit4]   2> 15686 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15686 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15693 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15693 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15693 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15693 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15693 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16008 T124 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16008 T124 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54823 collection:collection1 shard:shard1
[junit4:junit4]   2> 16014 T124 oasc.ZkController.register We are http://127.0.0.1:54823/collection1/ and leader is http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 16014 T124 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54823
[junit4:junit4]   2> 16014 T124 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16015 T124 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@57829097 url=http://127.0.0.1:54823/collection1 node=127.0.0.1:54823_ C2_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:54823_, base_url=http://127.0.0.1:54823}
[junit4:junit4]   2> 16015 T126 C2 P54823 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16016 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16016 T126 C2 P54823 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16016 T124 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 16016 T126 C2 P54823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16018 T126 C2 P54823 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16018 T48 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 16019 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16020 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16222 T48 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 16225 T48 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10394
[junit4:junit4]   2> 16226 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16227 T48 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16227 T48 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603
[junit4:junit4]   2> 16228 T48 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/solr.xml
[junit4:junit4]   2> 16228 T48 oasc.CoreContainer.<init> New CoreContainer 1618524531
[junit4:junit4]   2> 16229 T48 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/'
[junit4:junit4]   2> 16229 T48 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/'
[junit4:junit4]   2> 16282 T48 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 16283 T48 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16283 T48 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16284 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16284 T48 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16285 T48 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16285 T48 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16286 T48 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16286 T48 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16287 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16308 T48 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16329 T48 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23429/solr
[junit4:junit4]   2> 16330 T48 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16330 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6e7d30b3
[junit4:junit4]   2> 16332 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16332 T137 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16333 T137 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 16333 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49731
[junit4:junit4]   2> 16334 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49731
[junit4:junit4]   2> 16336 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc6000b with negotiated timeout 20000 for client /140.211.11.196:49731
[junit4:junit4]   2> 16336 T137 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc6000b, negotiated timeout = 20000
[junit4:junit4]   2> 16337 T138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e7d30b3 name:ZooKeeperConnection Watcher:127.0.0.1:23429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16337 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16339 T53 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6f303fc6000b
[junit4:junit4]   2> 16355 T138 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16355 T48 oaz.ZooKeeper.close Session: 0x13d6f303fc6000b closed
[junit4:junit4]   2> 16355 T50 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49731 which had sessionid 0x13d6f303fc6000b
[junit4:junit4]   2> 16356 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 16367 T48 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23429/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d12e9e6
[junit4:junit4]   2> 16368 T48 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16368 T139 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23429. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16369 T139 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23429, initiating session
[junit4:junit4]   2> 16369 T50 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45568
[junit4:junit4]   2> 16370 T50 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45568
[junit4:junit4]   2> 16371 T52 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6f303fc6000c with negotiated timeout 20000 for client /140.211.11.196:45568
[junit4:junit4]   2> 16371 T139 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23429, sessionid = 0x13d6f303fc6000c, negotiated timeout = 20000
[junit4:junit4]   2> 16372 T140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d12e9e6 name:ZooKeeperConnection Watcher:127.0.0.1:23429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16372 T48 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16373 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16375 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16378 T48 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:55409_, base_url=http://127.0.0.1:55409}
[junit4:junit4]   2> 16824 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45822/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 16834 T109 C1 P55409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 16851 T109 C1 P55409 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:55409 START replicas=[http://127.0.0.1:45822/collection1/] nUpdates=100
[junit4:junit4]   2> 16862 T109 C1 P55409 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 16862 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 16863 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 16863 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 16863 T109 C1 P55409 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 16864 T109 C1 P55409 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45822/collection1/. core=collection1
[junit4:junit4]   2> 16864 T109 C1 P55409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@4e5a5622 url=http://127.0.0.1:45822/collection1 node=127.0.0.1:45822_ C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45822_, base_url=http://127.0.0.1:45822, leader=true}
[junit4:junit4]   2> 16907 T82 C3 P45822 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 16950 T83 C3 P45822 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 16952 T83 C3 P45822 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 16953 T83 C3 P45822 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 16954 T83 C3 P45822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 16955 T83 C3 P45822 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 16956 T83 C3 P45822 oass.SolrIndexSearcher.<init> Opening Searcher@71cdecf7 realtime
[junit4:junit4]   2> 16957 T83 C3 P45822 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 16957 T83 C3 P45822 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 50
[junit4:junit4]   2> 16959 T109 C1 P55409 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 16960 T109 C1 P55409 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 16981 T109 C1 P55409 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 17038 T84 C3 P45822 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17039 T84 C3 P45822 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=55
[junit4:junit4]   2> 17040 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 17041 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 17041 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 17045 T84 C3 P45822 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4]   2> 17046 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 17048 T109 C1 P55409 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty2/index.20130315115442617 forceNew: false
[junit4:junit4]   2> 17049 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d73b35d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c97cb70) fullCopy=false
[junit4:junit4]   2> 17060 T84 C3 P45822 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=3
[junit4:junit4]   2> 17066 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 17073 T109 C1 P55409 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 17074 T109 C1 P55409 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 17076 T109 C1 P55409 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@34e6529c lockFactory=org.apache.lucene.store.NativeFSLockFactory@50e8709d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@34e6529c lockFactory=org.apache.lucene.store.NativeFSLockFactory@50e8709d)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17077 T109 C1 P55409 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17077 T109 C1 P55409 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 17078 T109 C1 P55409 oass.SolrIndexSearcher.<init> Opening Searcher@1f710374 main
[junit4:junit4]   2> 17087 T108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f710374 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 17088 T109 C1 P55409 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d73b35d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c97cb70)
[junit4:junit4]   2> 17089 T109 C1 P55409 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 17089 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 17090 T109 C1 P55409 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 17090 T109 C1 P55409 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17099 T109 C1 P55409 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17209 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17210 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:54823_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:54823"}
[junit4:junit4]   2> 17260 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:55409_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:55409"}
[junit4:junit4]   2> 17315 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17315 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17315 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17315 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17315 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17315 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17382 T48 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10394_
[junit4:junit4]   2> 17384 T53 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6f303fc6000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10394_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10394_
[junit4:junit4]   2> 17388 T48 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10394_
[junit4:junit4]   2> 17392 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17392 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17392 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17393 T140 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17393 T77 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17394 T70 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17394 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17394 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17394 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17396 T123 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17396 T106 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17397 T90 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 17404 T143 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/collection1
[junit4:junit4]   2> 17405 T143 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 17406 T143 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 17406 T143 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 17408 T143 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/collection1/'
[junit4:junit4]   2> 17410 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 17410 T143 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/collection1/lib/README' to classloader
[junit4:junit4]   2> 17489 T143 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 17560 T143 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17661 T143 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17694 T143 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 18035 T81 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:54823_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4]   2> 18698 T143 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 18718 T143 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 18724 T143 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 18752 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18759 T143 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18765 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18767 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18768 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18769 T143 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18770 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18770 T143 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18771 T143 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18771 T143 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363370081603/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/
[junit4:junit4]   2> 18772 T143 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@49198ff2
[junit4:junit4]   2> 18773 T143 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 18774 T143 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4 forceNew: false
[junit4:junit4]   2> 18775 T143 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/index/
[junit4:junit4]   2> 18775 T143 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 18776 T143 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/index forceNew: false
[junit4:junit4]   2> 18779 T143 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4196c169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d247c45)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 18780 T143 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 18784 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 18785 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 18786 T143 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 18787 T143 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 18788 T143 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 18789 T143 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 18789 T143 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 18790 T143 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 18791 T143 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 18799 T143 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 18806 T143 oass.SolrIndexSearcher.<init> Opening Searcher@53c6a7fc main
[junit4:junit4]   2> 18807 T143 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/tlog
[junit4:junit4]   2> 18808 T143 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 18808 T143 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 18816 T144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53c6a7fc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 18820 T143 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18821 T143 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18826 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 18828 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:10394_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:10394"}
[junit4:junit4]   2> 18828 T71 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 18829 T71 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 18844 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18844 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18844 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18844 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18844 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 18844 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19824 T143 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 19824 T143 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10394 collection:collection1 shard:shard1
[junit4:junit4]   2> 19829 T143 oasc.ZkController.register We are http://127.0.0.1:10394/collection1/ and leader is http://127.0.0.1:45822/collection1/
[junit4:junit4]   2> 19829 T143 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10394
[junit4:junit4]   2> 19830 T143 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 19830 T143 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@473dd7d1 url=http://127.0.0.1:10394/collection1 node=127.0.0.1:10394_ C4_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:10394_, base_url=http://127.0.0.1:10394}
[junit4:junit4]   2> 19830 T145 C4 P10394 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 19831 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 19831 T145 C4 P10394 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 19831 T145 C4 P10394 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19832 T143 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 19833 T145 C4 P10394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19834 T48 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 19835 T48 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 19835 T48 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19849 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 19852 T48 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 19853 T48 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 19854 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:54823_, base_url=http://127.0.0.1:54823}
[junit4:junit4]   2> 20037 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45822/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 20037 T126 C2 P54823 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54823 START replicas=[http://127.0.0.1:45822/collection1/] nUpdates=100
[junit4:junit4]   2> 20038 T126 C2 P54823 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 20038 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 20038 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 20038 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 20039 T126 C2 P54823 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 20039 T126 C2 P54823 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45822/collection1/. core=collection1
[junit4:junit4]   2> 20040 T126 C2 P54823 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20042 T82 C3 P45822 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 20049 T86 C3 P45822 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 20050 T86 C3 P45822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 20050 T86 C3 P45822 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 20051 T86 C3 P45822 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 20051 T86 C3 P45822 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4]   2> 20052 T126 C2 P54823 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 20052 T126 C2 P54823 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 20056 T84 C3 P45822 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 20057 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 20058 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 20058 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 20062 T84 C3 P45822 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4]   2> 20063 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 20064 T126 C2 P54823 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty3/index.20130315115445633 forceNew: false
[junit4:junit4]   2> 20064 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cd41115 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f112776) fullCopy=false
[junit4:junit4]   2> 20068 T84 C3 P45822 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4]   2> 20070 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 20070 T126 C2 P54823 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 20071 T126 C2 P54823 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 20072 T126 C2 P54823 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d2fb7ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@236eacf1)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d2fb7ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@236eacf1)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 20087 T126 C2 P54823 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 20087 T126 C2 P54823 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 20087 T126 C2 P54823 oass.SolrIndexSearcher.<init> Opening Searcher@292f8a71 main
[junit4:junit4]   2> 20088 T125 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@292f8a71 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 20089 T126 C2 P54823 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cd41115 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f112776)
[junit4:junit4]   2> 20089 T126 C2 P54823 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 20089 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 20090 T126 C2 P54823 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 20090 T126 C2 P54823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20094 T126 C2 P54823 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 20350 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 20351 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:10394_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:10394"}
[junit4:junit4]   2> 20356 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:54823_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:54823"}
[junit4:junit4]   2> 20370 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20370 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20370 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20370 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20370 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20370 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20849 T85 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=5&state=recovering&nodeName=127.0.0.1:10394_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4]   2> 20857 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 21860 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:10394_, base_url=http://127.0.0.1:10394}
[junit4:junit4]   2> 22851 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45822/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 22851 T145 C4 P10394 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:10394 START replicas=[http://127.0.0.1:45822/collection1/] nUpdates=100
[junit4:junit4]   2> 22852 T145 C4 P10394 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 22852 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 22853 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 22853 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 22853 T145 C4 P10394 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 22854 T145 C4 P10394 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45822/collection1/. core=collection1
[junit4:junit4]   2> 22854 T145 C4 P10394 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 22855 T82 C3 P45822 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 22863 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22869 T80 C3 P45822 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22870 T80 C3 P45822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22871 T80 C3 P45822 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22872 T80 C3 P45822 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22872 T80 C3 P45822 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4]   2> 22873 T145 C4 P10394 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 22874 T145 C4 P10394 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 22877 T84 C3 P45822 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 22878 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 22878 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 22879 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 22882 T84 C3 P45822 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4]   2> 22883 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 22884 T145 C4 P10394 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363370065579/jetty4/index.20130315115448453 forceNew: false
[junit4:junit4]   2> 22884 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a30a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4603278f) fullCopy=false
[junit4:junit4]   2> 22888 T84 C3 P45822 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1
[junit4:junit4]   2> 22889 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 22890 T145 C4 P10394 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 22891 T145 C4 P10394 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 22893 T145 C4 P10394 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4196c169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d247c45)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4196c169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d247c45)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22894 T145 C4 P10394 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22894 T145 C4 P10394 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 22894 T145 C4 P10394 oass.SolrIndexSearcher.<init> Opening Searcher@727a9fa7 main
[junit4:junit4]   2> 22896 T144 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@727a9fa7 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 22897 T145 C4 P10394 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a30a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4603278f)
[junit4:junit4]   2> 22898 T145 C4 P10394 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 22898 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 22898 T145 C4 P10394 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 22899 T145 C4 P10394 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22903 T145 C4 P10394 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 23386 T71 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 23388 T71 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:10394_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:10394"}
[junit4:junit4]   2> 23403 T106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23403 T70 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23403 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23403 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23403 T123 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23403 T140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23866 T48 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 23867 T48 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@146bf551 url=http://127.0.0.1:30354/collection1 node=127.0.0.1:30354_ C5_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:30354_, base_url=http://127.0.0.1:30354, leader=true}
[junit4:junit4]   2> 23877 T60 C5 P30354 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23880 T60 C5 P30354 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@578caee7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7baf1ad8)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23880 T60 C5 P30354 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23881 T60 C5 P30354 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@578caee7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7baf1ad8)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@578caee7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7baf1ad8)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23882 T60 C5 P30354 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23883 T60 C5 P30354 oass.SolrIndexSearcher.<init> Opening Searcher@66bccad2 main
[junit4:junit4]   2> 23883 T60 C5 P30354 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23884 T74 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66bccad2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 23885 T60 C5 P30354 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   2> 23909 T83 C3 P45822 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23910 T83 C3 P45822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@bb277f0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36592bb1)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 23911 T83 C3 P45822 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 23911 T83 C3 P45822 oass.SolrIndexSearcher.<init> Opening Searcher@46837311 main
[junit4:junit4]   2> 23912 T83 C3 P45822 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23913 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46837311 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 23928 T83 C3 P45822 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:55409/collection1/, StdNode: http://127.0.0.1:54823/collection1/, StdNode: http://127.0.0.1:10394/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:54823_, base_url=http://127.0.0.1:54823}
[junit4:junit4]   2> 23945 T113 C2 P54823 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10394_, base_url=http://127.0.0.1:10394}
[junit4:junit4]   2> 23945 T130 C4 P10394 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:55409_, base_url=http://127.0.0.1:55409}
[junit4:junit4]   2> 23946 T96 C1 P55409 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23947 T130 C4 P10394 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4196c169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d247c45)),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4196c169 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d247c45)),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 23947 T113 C2 P54823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3d2fb7ef lockFactory=org.apache.lucene.store.NativeFSLockFactory@236eacf1)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(or

[...truncated too long message...]

ter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 141376 T1149 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 141668 T1152 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 157258 T1240 oasc.SolrException.log SEVERE Sync request error: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:59717/collection1
[junit4:junit4]   2> 157259 T1240 oasc.SyncStrategy.syncToMe http://127.0.0.1:36588/collection1/: Sync failed - asking replica (http://127.0.0.1:59717/collection1/) to recover.
[junit4:junit4]   2> 157259 T1240 oasc.SyncStrategy.syncToMe We have been closed, don't request that a replica recover
[junit4:junit4]   2> 157259 T1240 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36588/collection1/
[junit4:junit4]   2> 157259 T1240 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6bcd4d4c
[junit4:junit4]   2> 157267 T1240 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=35,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 157268 T1240 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 157268 T1240 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 157268 T1240 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 157271 T1240 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 157272 T1240 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4/index.20130316045858107
[junit4:junit4]   2> 157272 T1240 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4/index.20130316045858107
[junit4:junit4]   2> 157272 T1240 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4
[junit4:junit4]   2> 157272 T1240 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4
[junit4:junit4]   2> 157273 T1240 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4/index
[junit4:junit4]   2> 157273 T1240 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363370313340/jetty4/index
[junit4:junit4]   2> 157273 T1240 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 157273 T1240 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89349836855509004-5-n_0000000001
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4]   2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4]   2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2>
[junit4:junit4]   2> 157274 T1240 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 157274 T1240 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 157274 T1240 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 157274 T1240 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 157275 T1240 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 157275 T1240 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2>
[junit4:junit4]   2> 157275 T1240 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=el, timezone=Australia/LHI
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=87487328,total=470089728
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestRecovery, ZkNodePropsTest, FileUtilsTest, FieldAnalysisRequestHandlerTest, TestIndexSearcher, BadIndexSchemaTest, TestSolrXMLSerializer, TestFiltering, TestMultiCoreConfBootstrap, ConvertedLegacyTest, DocumentAnalysisRequestHandlerTest, SolrIndexConfigTest, DistanceFunctionTest, IndexBasedSpellCheckerTest, ZkSolrClientTest, TestSuggestSpellingConverter, TestBinaryResponseWriter, PingRequestHandlerTest, SolrCmdDistributorTest, TestBM25SimilarityFactory, DOMUtilTest, SpellCheckCollatorTest, NumericFieldsTest, TestDynamicFieldCollectionResource, SolrRequestParserTest, CollectionsAPIDistributedZkTest, DateMathParserTest, SpellCheckComponentTest, TestIndexingPerformance, CurrencyFieldXmlFileTest, IndexReaderFactoryTest, FullSolrCloudDistribCmdsTest, ClusterStateTest, XmlUpdateRequestHandlerTest, TestAtomicUpdateErrorCases, TestFastOutputStream, TestLazyCores, CoreContainerCoreInitFailuresTest, DocValuesMultiTest, TestOmitPositions, TestFieldTypeResource, DefaultValueUpdateProcessorTest, SuggesterWFSTTest, TestNumberUtils, TestDefaultSimilarityFactory, TimeZoneUtilsTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 157.57s, 1 test, 1 error <<< FAILURES!

[...truncated 573 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 error, 1 failure, 28 ignored (9 assumptions)

Total time: 54 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1425 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1425/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:48602/collection1lastClient and got 5 from http://127.0.0.1:48610/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:48602/collection1lastClient and got 5 from http://127.0.0.1:48610/collection1
        at __randomizedtesting.SeedInfo.seed([73FF31D1C0181883:F219BFC9B74778BF]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:234)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8566 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T14 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 8 T14 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363394201794
[junit4:junit4]   2> 15 T14 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 22 T15 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 120 T15 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 121 T15 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 121 T15 oaz.Environment.logEnv Server environment:java.version=1.6.0_32
[junit4:junit4]   2> 121 T15 oaz.Environment.logEnv Server environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 122 T15 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 122 T15 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 124 T15 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 125 T15 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 125 T15 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 125 T15 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4]   2> 126 T15 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 126 T15 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 127 T15 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4]   2> 127 T15 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4]   2> 127 T15 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 190 T15 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 190 T15 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 191 T15 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 199 T15 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 222 T14 oasc.ZkTestServer.run start zk server on port:50067
[junit4:junit4]   2> 331 T15 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363394201794/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 353 T14 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 353 T14 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4]   2> 354 T14 oaz.Environment.logEnv Client environment:java.version=1.6.0_32
[junit4:junit4]   2> 354 T14 oaz.Environment.logEnv Client environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4]   2> 355 T14 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4]   2> 355 T14 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/common/lucene-analyzers-common-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/codecs/lucene-codecs-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/highlighter/lucene-highlighter-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/memory/lucene-memory-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/misc/lucene-misc-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/spatial/lucene-spatial-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/suggest/lucene-suggest-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/grouping/lucene-grouping-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queries/lucene-queries-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/queryparser/lucene-queryparser-4.3-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 357 T14 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4]   2> 357 T14 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 357 T14 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 358 T14 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4]   2> 358 T14 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 359 T14 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4]   2> 360 T14 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4]   2> 360 T14 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4]   2> 361 T14 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 367 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f5fc606
[junit4:junit4]   2> 499 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 506 T19 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 509 T19 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 509 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54763
[junit4:junit4]   2> 543 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54763
[junit4:junit4]   2> 555 T18 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 587 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390000 with negotiated timeout 10000 for client /140.211.11.196:54763
[junit4:junit4]   2> 587 T19 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390000, negotiated timeout = 10000
[junit4:junit4]   2> 593 T20 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f5fc606 name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 594 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 597 T14 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 676 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390000
[junit4:junit4]   2> 677 T20 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 677 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390000 closed
[junit4:junit4]   2> 678 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:54763 which had sessionid 0x13d70a08a390000
[junit4:junit4]   2> 678 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c429be9
[junit4:junit4]   2> 679 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 680 T22 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 680 T22 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 681 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48832
[junit4:junit4]   2> 681 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48832
[junit4:junit4]   2> 683 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390001 with negotiated timeout 10000 for client /140.211.11.196:48832
[junit4:junit4]   2> 683 T22 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390001, negotiated timeout = 10000
[junit4:junit4]   2> 684 T23 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c429be9 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 684 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 696 T14 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 703 T14 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 708 T14 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 713 T14 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 719 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 740 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 756 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 758 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 872 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 873 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 900 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 901 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 908 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 909 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 917 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 918 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 938 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 940 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 977 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 979 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1003 T14 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1004 T14 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1036 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390001
[junit4:junit4]   2> 1037 T23 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1037 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390001 closed
[junit4:junit4]   2> 1037 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48832 which had sessionid 0x13d70a08a390001
[junit4:junit4]   2> 1705 T14 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1917 T14 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25865
[junit4:junit4]   2> 1955 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1956 T14 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1956 T14 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824
[junit4:junit4]   2> 1957 T14 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/solr.xml
[junit4:junit4]   2> 1957 T14 oasc.CoreContainer.<init> New CoreContainer 2010395585
[junit4:junit4]   2> 1958 T14 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/'
[junit4:junit4]   2> 1959 T14 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/'
[junit4:junit4]   2> 2063 T14 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 2064 T14 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2065 T14 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2065 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2066 T14 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2067 T14 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2067 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2068 T14 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2069 T14 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2174 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2810 T14 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2828 T14 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50067/solr
[junit4:junit4]   2> 2885 T14 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2886 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c7ba849
[junit4:junit4]   2> 2887 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2888 T34 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2889 T34 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 2890 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58058
[junit4:junit4]   2> 2891 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58058
[junit4:junit4]   2> 2894 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390002 with negotiated timeout 20000 for client /140.211.11.196:58058
[junit4:junit4]   2> 2895 T34 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390002, negotiated timeout = 20000
[junit4:junit4]   2> 2896 T35 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c7ba849 name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2896 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2915 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390002
[junit4:junit4]   2> 2917 T35 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2917 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390002 closed
[junit4:junit4]   2> 2917 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:58058 which had sessionid 0x13d70a08a390002
[junit4:junit4]   2> 2946 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 2959 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@446023f7
[junit4:junit4]   2> 2960 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2960 T36 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2961 T36 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 2961 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35546
[junit4:junit4]   2> 2962 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35546
[junit4:junit4]   2> 2963 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390003 with negotiated timeout 20000 for client /140.211.11.196:35546
[junit4:junit4]   2> 2964 T36 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390003, negotiated timeout = 20000
[junit4:junit4]   2> 2964 T37 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@446023f7 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2965 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3022 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3034 T14 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 3038 T14 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25865_
[junit4:junit4]   2> 3064 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:25865_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:25865_
[junit4:junit4]   2> 3066 T14 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25865_
[junit4:junit4]   2> 3071 T14 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 3125 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 3127 T14 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 3156 T14 oasc.Overseer.start Overseer (id=89351402433347587-127.0.0.1:25865_-n_0000000000) starting
[junit4:junit4]   2> 3157 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3190 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3192 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3217 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3219 T39 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 3221 T14 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 3283 T14 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 3291 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3310 T38 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 3350 T40 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/collection1
[junit4:junit4]   2> 3351 T40 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 3353 T40 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3353 T40 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 3363 T40 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/collection1/'
[junit4:junit4]   2> 3365 T40 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3366 T40 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/collection1/lib/README' to classloader
[junit4:junit4]   2> 3465 T40 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 3558 T40 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3659 T40 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3720 T40 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4503 T40 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4517 T40 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4520 T40 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4549 T40 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4556 T40 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4561 T40 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4564 T40 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 4564 T40 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 4565 T40 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4566 T40 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 4567 T40 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 4567 T40 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 4591 T40 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363394202824/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/
[junit4:junit4]   2> 4599 T40 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72940b84
[junit4:junit4]   2> 4605 T40 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 4610 T40 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data forceNew: false
[junit4:junit4]   2> 4612 T40 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index/
[junit4:junit4]   2> 4613 T40 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4614 T40 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index forceNew: false
[junit4:junit4]   2> 4633 T40 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@78d5c653; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4633 T40 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4715 T40 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4716 T40 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4808 T40 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4813 T40 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4831 T40 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4831 T40 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4834 T40 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4848 T40 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4852 T40 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4858 T40 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4865 T40 oass.SolrIndexSearcher.<init> Opening Searcher@54ed3e63 main
[junit4:junit4]   2> 4886 T40 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4886 T40 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4946 T41 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54ed3e63 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4951 T40 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4951 T40 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4952 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x58 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 6389 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 6390 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:25865_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:25865"}
[junit4:junit4]   2> 6391 T38 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 6413 T38 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6415 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x60 zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 6450 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 6964 T40 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6964 T40 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25865 collection:control_collection shard:shard1
[junit4:junit4]   2> 6974 T40 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6987 T40 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 7009 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:delete cxid:0x7a zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 7011 T40 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7012 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x7b zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7025 T40 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7026 T40 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7041 T40 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25865/collection1/
[junit4:junit4]   2> 7042 T40 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7043 T40 oasc.SyncStrategy.syncToMe http://127.0.0.1:25865/collection1/ has no replicas
[junit4:junit4]   2> 7043 T40 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25865/collection1/
[junit4:junit4]   2> 7044 T40 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 7114 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390003 type:create cxid:0x85 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7958 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8018 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 8051 T40 oasc.ZkController.register We are http://127.0.0.1:25865/collection1/ and leader is http://127.0.0.1:25865/collection1/
[junit4:junit4]   2> 8054 T40 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25865
[junit4:junit4]   2> 8054 T40 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8054 T40 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8055 T40 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8058 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8064 T14 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8065 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8138 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8162 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 8168 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@60396ed8
[junit4:junit4]   2> 8170 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8170 T43 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8171 T43 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 8171 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48593
[junit4:junit4]   2> 8172 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48593
[junit4:junit4]   2> 8174 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390004 with negotiated timeout 10000 for client /140.211.11.196:48593
[junit4:junit4]   2> 8174 T43 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390004, negotiated timeout = 10000
[junit4:junit4]   2> 8174 T44 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60396ed8 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8175 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8177 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 8183 T14 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 8377 T14 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8380 T14 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48594
[junit4:junit4]   2> 8381 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8382 T14 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8383 T14 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968
[junit4:junit4]   2> 8383 T14 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/solr.xml
[junit4:junit4]   2> 8384 T14 oasc.CoreContainer.<init> New CoreContainer 1894868328
[junit4:junit4]   2> 8385 T14 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/'
[junit4:junit4]   2> 8386 T14 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/'
[junit4:junit4]   2> 8460 T14 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8461 T14 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8462 T14 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8463 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8464 T14 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8464 T14 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8465 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8466 T14 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8466 T14 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8467 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8490 T14 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8514 T14 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50067/solr
[junit4:junit4]   2> 8515 T14 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8515 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@31313e0e
[junit4:junit4]   2> 8517 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8518 T54 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8519 T54 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 8519 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48595
[junit4:junit4]   2> 8520 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48595
[junit4:junit4]   2> 8522 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390005 with negotiated timeout 20000 for client /140.211.11.196:48595
[junit4:junit4]   2> 8522 T54 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390005, negotiated timeout = 20000
[junit4:junit4]   2> 8523 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31313e0e name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8524 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8526 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390005
[junit4:junit4]   2> 8534 T55 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8534 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48595 which had sessionid 0x13d70a08a390005
[junit4:junit4]   2> 8534 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390005 closed
[junit4:junit4]   2> 8535 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8542 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@752a2259
[junit4:junit4]   2> 8543 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8544 T56 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8545 T56 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 8545 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48596
[junit4:junit4]   2> 8546 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48596
[junit4:junit4]   2> 8548 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390006 with negotiated timeout 20000 for client /140.211.11.196:48596
[junit4:junit4]   2> 8548 T56 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390006, negotiated timeout = 20000
[junit4:junit4]   2> 8549 T57 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@752a2259 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8549 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8551 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8553 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8557 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 9534 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 9536 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:25865_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:25865"}
[junit4:junit4]   2> 9551 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 9551 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 9551 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 9664 T14 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48594_
[junit4:junit4]   2> 9666 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:delete cxid:0xd zxid:0x50 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48594_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48594_
[junit4:junit4]   2> 9668 T14 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48594_
[junit4:junit4]   2> 9679 T57 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 9679 T37 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 9680 T44 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 9680 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9680 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9680 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9691 T58 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/collection1
[junit4:junit4]   2> 9692 T58 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9693 T58 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9693 T58 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9695 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/collection1/'
[junit4:junit4]   2> 9697 T58 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9697 T58 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/collection1/lib/README' to classloader
[junit4:junit4]   2> 9777 T58 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9846 T58 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9948 T58 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10001 T58 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10709 T58 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10729 T58 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10734 T58 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10768 T58 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10776 T58 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10783 T58 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10785 T58 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10786 T58 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10786 T58 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10788 T58 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10789 T58 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10789 T58 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10790 T58 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363394209968/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/
[junit4:junit4]   2> 10790 T58 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72940b84
[junit4:junit4]   2> 10792 T58 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10793 T58 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1 forceNew: false
[junit4:junit4]   2> 10794 T58 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index/
[junit4:junit4]   2> 10795 T58 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10796 T58 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index forceNew: false
[junit4:junit4]   2> 10803 T58 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10803 T58 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10808 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10809 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10810 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10813 T58 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10815 T58 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10816 T58 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10816 T58 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10819 T58 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10820 T58 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10827 T58 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10837 T58 oass.SolrIndexSearcher.<init> Opening Searcher@6ff80c0e main
[junit4:junit4]   2> 10838 T58 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10839 T58 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10860 T59 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ff80c0e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10865 T58 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10866 T58 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11075 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11077 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48594_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48594"}
[junit4:junit4]   2> 11077 T38 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 11077 T38 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11084 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11084 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11084 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11869 T58 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11869 T58 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48594 collection:collection1 shard:shard1
[junit4:junit4]   2> 11870 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11888 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:delete cxid:0x4a zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 11890 T58 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 11890 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:create cxid:0x4b zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11899 T58 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 11900 T58 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 11900 T58 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 11900 T58 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 11901 T58 oasc.SyncStrategy.syncToMe http://127.0.0.1:48594/collection1/ has no replicas
[junit4:junit4]   2> 11901 T58 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 11901 T58 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 11907 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390006 type:create cxid:0x55 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12598 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12630 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12630 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12630 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12682 T58 oasc.ZkController.register We are http://127.0.0.1:48594/collection1/ and leader is http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 12682 T58 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48594
[junit4:junit4]   2> 12682 T58 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 12683 T58 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 12683 T58 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12686 T58 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12688 T14 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 12689 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12689 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12888 T14 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12891 T14 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48599
[junit4:junit4]   2> 12892 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12892 T14 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12893 T14 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490
[junit4:junit4]   2> 12894 T14 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/solr.xml
[junit4:junit4]   2> 12894 T14 oasc.CoreContainer.<init> New CoreContainer 1472005823
[junit4:junit4]   2> 12895 T14 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/'
[junit4:junit4]   2> 12896 T14 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/'
[junit4:junit4]   2> 12951 T14 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12952 T14 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12952 T14 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12953 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12953 T14 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12954 T14 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12955 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12955 T14 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12956 T14 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12957 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12980 T14 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 13002 T14 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50067/solr
[junit4:junit4]   2> 13003 T14 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 13003 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@baf1915
[junit4:junit4]   2> 13005 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13005 T70 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 13006 T70 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 13007 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48600
[junit4:junit4]   2> 13007 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48600
[junit4:junit4]   2> 13010 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390007 with negotiated timeout 20000 for client /140.211.11.196:48600
[junit4:junit4]   2> 13010 T70 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390007, negotiated timeout = 20000
[junit4:junit4]   2> 13011 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@baf1915 name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13011 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13013 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390007
[junit4:junit4]   2> 13023 T71 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13023 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48600 which had sessionid 0x13d70a08a390007
[junit4:junit4]   2> 13023 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390007 closed
[junit4:junit4]   2> 13025 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 13037 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@bdbb12b
[junit4:junit4]   2> 13039 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 13039 T72 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 13040 T72 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 13040 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48601
[junit4:junit4]   2> 13041 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48601
[junit4:junit4]   2> 13043 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390008 with negotiated timeout 20000 for client /140.211.11.196:48601
[junit4:junit4]   2> 13044 T72 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390008, negotiated timeout = 20000
[junit4:junit4]   2> 13044 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bdbb12b name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 13045 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 13046 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13048 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13052 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 14061 T14 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48599_
[junit4:junit4]   2> 14063 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a390008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48599_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48599_
[junit4:junit4]   2> 14064 T14 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48599_
[junit4:junit4]   2> 14068 T57 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 14068 T73 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 14068 T37 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 14068 T44 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 14068 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14068 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14069 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14078 T74 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/collection1
[junit4:junit4]   2> 14078 T74 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14079 T74 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14079 T74 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14081 T74 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/collection1/'
[junit4:junit4]   2> 14082 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 14083 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/collection1/lib/README' to classloader
[junit4:junit4]   2> 14134 T74 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 14144 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 14145 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"2",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48594_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48594"}
[junit4:junit4]   2> 14159 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14159 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14159 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14159 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14206 T74 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14307 T74 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14348 T74 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14957 T74 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14975 T74 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14981 T74 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15015 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15022 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15027 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15029 T74 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15029 T74 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15030 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15031 T74 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15031 T74 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15032 T74 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 15032 T74 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363394214490/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/
[junit4:junit4]   2> 15032 T74 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72940b84
[junit4:junit4]   2> 15033 T74 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 15034 T74 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2 forceNew: false
[junit4:junit4]   2> 15035 T74 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index/
[junit4:junit4]   2> 15035 T74 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15036 T74 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index forceNew: false
[junit4:junit4]   2> 15070 T74 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@314955ec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15071 T74 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15074 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15075 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15076 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15077 T74 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15078 T74 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15079 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15079 T74 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15081 T74 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15081 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15087 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15094 T74 oass.SolrIndexSearcher.<init> Opening Searcher@1d667df0 main
[junit4:junit4]   2> 15095 T74 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15095 T74 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15108 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d667df0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15113 T74 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15113 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15671 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 15673 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48599_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48599"}
[junit4:junit4]   2> 15673 T38 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15673 T38 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15689 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15689 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15689 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15689 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16116 T74 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16116 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48599 collection:collection1 shard:shard1
[junit4:junit4]   2> 16120 T74 oasc.ZkController.register We are http://127.0.0.1:48599/collection1/ and leader is http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 16121 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48599
[junit4:junit4]   2> 16121 T74 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 16121 T74 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@424c2849 url=http://127.0.0.1:48599/collection1 node=127.0.0.1:48599_ C2_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48599_, base_url=http://127.0.0.1:48599}
[junit4:junit4]   2> 16128 T76 C2 P48599 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 16128 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 16129 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 16129 T76 C2 P48599 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 16129 T76 C2 P48599 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16130 T14 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 16130 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 16131 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16131 T76 C2 P48599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 16296 T14 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 16300 T14 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48602
[junit4:junit4]   2> 16301 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16301 T14 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16301 T14 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928
[junit4:junit4]   2> 16302 T14 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/solr.xml
[junit4:junit4]   2> 16302 T14 oasc.CoreContainer.<init> New CoreContainer 2040380475
[junit4:junit4]   2> 16303 T14 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/'
[junit4:junit4]   2> 16303 T14 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/'
[junit4:junit4]   2> 16528 T14 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 16529 T14 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16529 T14 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16530 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16530 T14 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16530 T14 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16531 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16531 T14 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16532 T14 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16532 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16576 T14 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16663 T14 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50067/solr
[junit4:junit4]   2> 16663 T14 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16664 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@df5cbd6
[junit4:junit4]   2> 16665 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16665 T87 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16666 T87 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 16666 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48603
[junit4:junit4]   2> 16667 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48603
[junit4:junit4]   2> 16669 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a390009 with negotiated timeout 20000 for client /140.211.11.196:48603
[junit4:junit4]   2> 16669 T87 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a390009, negotiated timeout = 20000
[junit4:junit4]   2> 16670 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@df5cbd6 name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16671 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16673 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a390009
[junit4:junit4]   2> 16680 T88 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16680 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48603 which had sessionid 0x13d70a08a390009
[junit4:junit4]   2> 16680 T14 oaz.ZooKeeper.close Session: 0x13d70a08a390009 closed
[junit4:junit4]   2> 16681 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 16694 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6d69c9a2
[junit4:junit4]   2> 16696 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16696 T89 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16697 T89 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 16697 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48604
[junit4:junit4]   2> 16698 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48604
[junit4:junit4]   2> 16699 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a39000a with negotiated timeout 20000 for client /140.211.11.196:48604
[junit4:junit4]   2> 16700 T89 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a39000a, negotiated timeout = 20000
[junit4:junit4]   2> 16700 T90 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d69c9a2 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16701 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16702 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16704 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16709 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 17195 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17197 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48599_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48599"}
[junit4:junit4]   2> 17244 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17244 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17244 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17244 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17244 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17293 T47 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=3&state=recovering&nodeName=127.0.0.1:48599_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=4
[junit4:junit4]   2> 17713 T14 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48602_
[junit4:junit4]   2> 17715 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48602_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48602_
[junit4:junit4]   2> 17716 T14 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48602_
[junit4:junit4]   2> 17731 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17731 T37 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 17731 T57 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 17731 T90 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 17732 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17732 T44 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 17733 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17732 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17733 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17734 T73 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 17742 T91 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/collection1
[junit4:junit4]   2> 17743 T91 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 17743 T91 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 17744 T91 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 17745 T91 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/collection1/'
[junit4:junit4]   2> 17747 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 17747 T91 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/collection1/lib/README' to classloader
[junit4:junit4]   2> 17813 T91 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 17865 T91 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 17966 T91 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17991 T91 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 18730 T91 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 18750 T91 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 18755 T91 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 18788 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18796 T91 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18803 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18805 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18805 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18806 T91 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18808 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 18808 T91 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 18809 T91 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 18809 T91 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363394217928/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/
[junit4:junit4]   2> 18810 T91 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72940b84
[junit4:junit4]   2> 18811 T91 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 18812 T91 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3 forceNew: false
[junit4:junit4]   2> 18813 T91 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index/
[junit4:junit4]   2> 18814 T91 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 18815 T91 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index forceNew: false
[junit4:junit4]   2> 18821 T91 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b48f7e0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 18821 T91 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 18825 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 18826 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 18827 T91 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 18828 T91 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 18829 T91 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 18829 T91 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 18830 T91 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 18831 T91 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 18831 T91 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 18837 T91 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 18843 T91 oass.SolrIndexSearcher.<init> Opening Searcher@54bec43f main
[junit4:junit4]   2> 18844 T91 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 18844 T91 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 18853 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54bec43f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 18857 T91 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18857 T91 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48599_, base_url=http://127.0.0.1:48599}
[junit4:junit4]   2> 19413 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48594/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 19423 T76 C2 P48599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 19447 T76 C2 P48599 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48599 START replicas=[http://127.0.0.1:48594/collection1/] nUpdates=100
[junit4:junit4]   2> 19459 T76 C2 P48599 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 19462 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 19462 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 19463 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 19463 T76 C2 P48599 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 19463 T76 C2 P48599 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48594/collection1/. core=collection1
[junit4:junit4]   2> 19464 T76 C2 P48599 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@5b3ac14d url=http://127.0.0.1:48594/collection1 node=127.0.0.1:48594_ C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48594_, base_url=http://127.0.0.1:48594, leader=true}
[junit4:junit4]   2> 19541 T48 C3 P48594 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4:junit4]   2> 19590 T49 C3 P48594 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 19633 T49 C3 P48594 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19636 T49 C3 P48594 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19659 T49 C3 P48594 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19661 T49 C3 P48594 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19663 T49 C3 P48594 oass.SolrIndexSearcher.<init> Opening Searcher@4ab8fba5 realtime
[junit4:junit4]   2> 19663 T49 C3 P48594 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 19664 T49 C3 P48594 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 95
[junit4:junit4]   2> 19754 T76 C2 P48599 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19755 T76 C2 P48599 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 19782 T76 C2 P48599 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 19847 T50 C3 P48594 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 19848 T50 C3 P48594 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=61
[junit4:junit4]   2> 19850 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 19851 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 19851 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 19855 T50 C3 P48594 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4]   2> 19856 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 19858 T76 C2 P48599 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index.20130316033701642 forceNew: false
[junit4:junit4]   2> 19859 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index.20130316033701642 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41a80e5a; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 19874 T50 C3 P48594 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
[junit4:junit4]   2> 19889 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 19929 T76 C2 P48599 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 19930 T76 C2 P48599 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 19934 T76 C2 P48599 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@314955ec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@314955ec; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 19939 T76 C2 P48599 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 19939 T76 C2 P48599 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 19941 T76 C2 P48599 oass.SolrIndexSearcher.<init> Opening Searcher@4537ef34 main
[junit4:junit4]   2> 19943 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4537ef34 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 19944 T76 C2 P48599 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty2/index.20130316033701642 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41a80e5a; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 19952 T76 C2 P48599 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 19953 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 19953 T76 C2 P48599 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 19953 T76 C2 P48599 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19959 T76 C2 P48599 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 20266 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 20268 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48602_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48602"}
[junit4:junit4]   2> 20268 T38 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 20268 T38 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 20278 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"3",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48599_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48599"}
[junit4:junit4]   2> 20292 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20292 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20292 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20292 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20292 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20861 T91 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 20861 T91 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48602 collection:collection1 shard:shard1
[junit4:junit4]   2> 20866 T91 oasc.ZkController.register We are http://127.0.0.1:48602/collection1/ and leader is http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 20866 T91 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48602
[junit4:junit4]   2> 20866 T91 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 20867 T91 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@6d4b2819 url=http://127.0.0.1:48602/collection1 node=127.0.0.1:48602_ C4_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48602_, base_url=http://127.0.0.1:48602}
[junit4:junit4]   2> 20867 T95 C4 P48602 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 20868 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 20868 T91 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 20868 T95 C4 P48602 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 20869 T95 C4 P48602 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20870 T14 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 20870 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 20870 T95 C4 P48602 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20871 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21041 T14 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 21044 T14 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48610
[junit4:junit4]   2> 21045 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 21046 T14 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 21047 T14 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668
[junit4:junit4]   2> 21047 T14 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/solr.xml
[junit4:junit4]   2> 21048 T14 oasc.CoreContainer.<init> New CoreContainer 197785851
[junit4:junit4]   2> 21049 T14 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/'
[junit4:junit4]   2> 21050 T14 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/'
[junit4:junit4]   2> 21096 T14 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 21096 T14 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 21097 T14 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 21097 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 21098 T14 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 21098 T14 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 21098 T14 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 21099 T14 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 21099 T14 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 21100 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 21118 T14 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 21138 T14 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:50067/solr
[junit4:junit4]   2> 21139 T14 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 21140 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2eeb3c84
[junit4:junit4]   2> 21149 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21150 T106 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 21151 T106 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 21151 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48611
[junit4:junit4]   2> 21152 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48611
[junit4:junit4]   2> 21154 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a39000b with negotiated timeout 20000 for client /140.211.11.196:48611
[junit4:junit4]   2> 21155 T106 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a39000b, negotiated timeout = 20000
[junit4:junit4]   2> 21155 T107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2eeb3c84 name:ZooKeeperConnection Watcher:127.0.0.1:50067 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21156 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21158 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d70a08a39000b
[junit4:junit4]   2> 21159 T107 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 21159 T14 oaz.ZooKeeper.close Session: 0x13d70a08a39000b closed
[junit4:junit4]   2> 21159 T16 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48611 which had sessionid 0x13d70a08a39000b
[junit4:junit4]   2> 21161 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 21175 T14 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50067/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5552bb15
[junit4:junit4]   2> 21176 T14 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 21177 T108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:50067. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 21178 T108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:50067, initiating session
[junit4:junit4]   2> 21178 T16 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48612
[junit4:junit4]   2> 21178 T16 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48612
[junit4:junit4]   2> 21180 T18 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d70a08a39000c with negotiated timeout 20000 for client /140.211.11.196:48612
[junit4:junit4]   2> 21180 T108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:50067, sessionid = 0x13d70a08a39000c, negotiated timeout = 20000
[junit4:junit4]   2> 21181 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5552bb15 name:ZooKeeperConnection Watcher:127.0.0.1:50067/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 21181 T14 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 21183 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000c type:create cxid:0x1 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21229 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000c type:create cxid:0x2 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21234 T14 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 21804 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 21806 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48602_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48602"}
[junit4:junit4]   2> 21818 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21818 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21818 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21818 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21818 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21818 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21887 T51 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:48602_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4]   2> 22240 T14 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48610_
[junit4:junit4]   2> 22246 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d70a08a39000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48610_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48610_
[junit4:junit4]   2> 22248 T14 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48610_
[junit4:junit4]   2> 22266 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22267 T44 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22267 T90 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22267 T109 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22267 T37 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22267 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22267 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22267 T57 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22268 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22268 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22268 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22269 T73 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 22276 T110 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/collection1
[junit4:junit4]   2> 22276 T110 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 22277 T110 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 22278 T110 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 22279 T110 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/collection1/'
[junit4:junit4]   2> 22280 T110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 22281 T110 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/collection1/lib/README' to classloader
[junit4:junit4]   2> 22322 T110 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 22368 T110 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 22469 T110 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 22505 T110 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 23180 T110 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 23193 T110 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 23196 T110 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 23221 T110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 23226 T110 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 23230 T110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 23232 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 23232 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 23232 T110 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 23234 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 23234 T110 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 23234 T110 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 23235 T110 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363394222668/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/
[junit4:junit4]   2> 23235 T110 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@72940b84
[junit4:junit4]   2> 23236 T110 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 23236 T110 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4 forceNew: false
[junit4:junit4]   2> 23237 T110 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index/
[junit4:junit4]   2> 23238 T110 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 23238 T110 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index forceNew: false
[junit4:junit4]   2> 23268 T110 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64fef26a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23269 T110 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23272 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 23273 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 23273 T110 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 23274 T110 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 23275 T110 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 23275 T110 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 23276 T110 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 23277 T110 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 23277 T110 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 23283 T110 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 23289 T110 oass.SolrIndexSearcher.<init> Opening Searcher@4cc7014c main
[junit4:junit4]   2> 23290 T110 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 23290 T110 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 23297 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4cc7014c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 23301 T110 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 23301 T110 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23327 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 23328 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48610_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48610"}
[junit4:junit4]   2> 23328 T38 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 23328 T38 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 23334 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23334 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23334 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23334 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23334 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23334 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48602_, base_url=http://127.0.0.1:48602}
[junit4:junit4]   2> 23889 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48594/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 23889 T95 C4 P48602 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48602 START replicas=[http://127.0.0.1:48594/collection1/] nUpdates=100
[junit4:junit4]   2> 23890 T95 C4 P48602 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 23890 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 23891 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 23891 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 23891 T95 C4 P48602 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 23891 T95 C4 P48602 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48594/collection1/. core=collection1
[junit4:junit4]   2> 23892 T95 C4 P48602 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23894 T48 C3 P48594 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 23905 T52 C3 P48594 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23912 T52 C3 P48594 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 23912 T52 C3 P48594 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 23913 T52 C3 P48594 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23914 T52 C3 P48594 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   2> 23915 T95 C4 P48602 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23915 T95 C4 P48602 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 23919 T50 C3 P48594 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 23920 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 23920 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 23920 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 23923 T50 C3 P48594 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4]   2> 23924 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 23925 T95 C4 P48602 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316033705709 forceNew: false
[junit4:junit4]   2> 23926 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316033705709 lockFactory=org.apache.lucene.store.NativeFSLockFactory@602f892f; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 23930 T50 C3 P48594 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=1
[junit4:junit4]   2> 23931 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 23934 T95 C4 P48602 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 23934 T95 C4 P48602 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 23937 T95 C4 P48602 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b48f7e0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b48f7e0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 23938 T95 C4 P48602 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 23938 T95 C4 P48602 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 23939 T95 C4 P48602 oass.SolrIndexSearcher.<init> Opening Searcher@56a96eba main
[junit4:junit4]   2> 23947 T92 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56a96eba main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 23948 T95 C4 P48602 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316033705709 lockFactory=org.apache.lucene.store.NativeFSLockFactory@602f892f; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 23949 T95 C4 P48602 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 23950 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 23950 T95 C4 P48602 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 23950 T95 C4 P48602 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23952 T95 C4 P48602 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 24304 T110 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 24304 T110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48610 collection:collection1 shard:shard1
[junit4:junit4]   2> 24309 T110 oasc.ZkController.register We are http://127.0.0.1:48610/collection1/ and leader is http://127.0.0.1:48594/collection1/
[junit4:junit4]   2> 24309 T110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48610
[junit4:junit4]   2> 24309 T110 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 24309 T110 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@1ea4daa3 url=http://127.0.0.1:48610/collection1 node=127.0.0.1:48610_ C5_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48610_, base_url=http://127.0.0.1:48610}
[junit4:junit4]   2> 24310 T114 C5 P48610 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 24310 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 24310 T110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 24311 T114 C5 P48610 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 24311 T114 C5 P48610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 24312 T14 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 24312 T14 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 24313 T114 C5 P48610 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 24313 T14 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 24332 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 24334 T14 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 24334 T14 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 24336 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 24849 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 24850 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"4",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48602_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48602"}
[junit4:junit4]   2> 24891 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48610_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48610"}
[junit4:junit4]   2> 24908 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24908 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24908 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24908 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24908 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24908 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25334 T53 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=5&state=recovering&nodeName=127.0.0.1:48610_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4]   2> 25339 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 26343 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C5_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48610_, base_url=http://127.0.0.1:48610}
[junit4:junit4]   2> 27336 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48594/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 27336 T114 C5 P48610 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48610 START replicas=[http://127.0.0.1:48594/collection1/] nUpdates=100
[junit4:junit4]   2> 27337 T114 C5 P48610 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 27337 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 27337 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 27337 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 27338 T114 C5 P48610 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 27338 T114 C5 P48610 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48594/collection1/. core=collection1
[junit4:junit4]   2> 27338 T114 C5 P48610 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 27340 T48 C3 P48594 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 27345 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 27348 T47 C3 P48594 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 27352 T47 C3 P48594 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 27353 T47 C3 P48594 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 27354 T47 C3 P48594 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 27354 T47 C3 P48594 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 27355 T114 C5 P48610 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 27356 T114 C5 P48610 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 27358 T50 C3 P48594 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 27359 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 27360 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 27360 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 27364 T50 C3 P48594 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4]   2> 27365 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 27366 T114 C5 P48610 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index.20130316033709150 forceNew: false
[junit4:junit4]   2> 27367 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index.20130316033709150 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5dcd8bf7; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 27371 T50 C3 P48594 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4]   2> 27373 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 27376 T114 C5 P48610 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 27376 T114 C5 P48610 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 27379 T114 C5 P48610 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64fef26a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64fef26a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 27380 T114 C5 P48610 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 27380 T114 C5 P48610 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 27381 T114 C5 P48610 oass.SolrIndexSearcher.<init> Opening Searcher@397d812b main
[junit4:junit4]   2> 27383 T111 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@397d812b main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 27384 T114 C5 P48610 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty4/index.20130316033709150 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5dcd8bf7; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 27385 T114 C5 P48610 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 27385 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 27385 T114 C5 P48610 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 27385 T114 C5 P48610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 27388 T114 C5 P48610 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 27933 T38 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 27935 T38 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"5",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48610_",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48610"}
[junit4:junit4]   2> 27969 T57 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27969 T44 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27969 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27969 T37 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27969 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27969 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 28349 T14 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 28350 T14 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@2b891172 url=http://127.0.0.1:25865/collection1 node=127.0.0.1:25865_ C6_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:25865_, base_url=http://127.0.0.1:25865, leader=true}
[junit4:junit4]   2> 28359 T27 C6 P25865 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 28363 T27 C6 P25865 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@78d5c653; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 28364 T27 C6 P25865 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 28367 T27 C6 P25865 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@78d5c653; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@78d5c653; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 28368 T27 C6 P25865 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 28370 T27 C6 P25865 oass.SolrIndexSearcher.<init> Opening Searcher@3771ed5e main
[junit4:junit4]   2> 28371 T27 C6 P25865 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 28373 T41 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3771ed5e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 28374 T27 C6 P25865 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   2> 28391 T49 C3 P48594 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 28395 T49 C3 P48594 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@427b2d29; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 28395 T49 C3 P48594 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 28396 T49 C3 P48594 oass.SolrIndexSearcher.<init> Opening Searcher@131b92e6 main
[junit4:junit4]   2> 28397 T49 C3 P48594 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 28398 T59 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@131b92e6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 28409 T49 C3 P48594 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:48599/collection1/, StdNode: http://127.0.0.1:48602/collection1/, StdNode: http://127.0.0.1:48610/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node

[...truncated too long message...]

che.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 813538 T14 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 814216 T17 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 814481 T109 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 814481 T109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 814481 T109 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 814482 T109 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 841029 T90 oasu.PeerSync.handleResponse WARNING PeerSync: core=collection1 url=http://127.0.0.1:48602  couldn't connect to http://127.0.0.1:48594/collection1/, counting as success
[junit4:junit4]   2> 841029 T90 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48602 DONE. sync succeeded
[junit4:junit4]   2> 841030 T90 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4]   2> 841030 T90 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4]   2> 841031 T90 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6d4b2819
[junit4:junit4]   2> 841034 T90 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=50,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 841034 T90 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 841034 T90 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 841035 T90 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 841035 T90 C4 P48602 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/tlog/tlog.0000000000000000003 refcount=2}
[junit4:junit4]   2> 841036 T90 C4 P48602 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/tlog/tlog.0000000000000000002 refcount=2}
[junit4:junit4]   2> 841036 T90 C4 P48602 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/tlog/tlog.0000000000000000001 refcount=2}
[junit4:junit4]   2> 841038 T90 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 841040 T90 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316034355586
[junit4:junit4]   2> 841041 T90 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316034355586
[junit4:junit4]   2> 841041 T90 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316033705709
[junit4:junit4]   2> 841041 T90 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3/index.20130316033705709
[junit4:junit4]   2> 841041 T90 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3
[junit4:junit4]   2> 841042 T90 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363394201794/jetty3
[junit4:junit4]   2> 841042 T90 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 841042 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 841043 T90 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 841043 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 841043 T90 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 841043 T90 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=is, timezone=Asia/Baghdad
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=428167968,total=458555392
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SuggesterFSTTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 841.80s, 1 test, 1 failure <<< FAILURES!

[...truncated 639 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 28 ignored (9 assumptions)

Total time: 57 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1426 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1426/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:


Stack Trace:
java.lang.AssertionError
        at __randomizedtesting.SeedInfo.seed([82F4053A28E7C00D:3128B225FB8A031]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertTrue(Assert.java:54)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:196)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8644 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T2001 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /p/
[junit4:junit4]   2> 6 T2001 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363413750772
[junit4:junit4]   2> 7 T2001 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T2002 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T2002 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11 T2002 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 11 T2002 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T2002 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T2002 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363413750772/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T2001 oasc.ZkTestServer.run start zk server on port:18913
[junit4:junit4]   2> 108 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@30d21291
[junit4:junit4]   2> 109 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 109 T2007 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 110 T2007 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 110 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18914
[junit4:junit4]   2> 111 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18914
[junit4:junit4]   2> 111 T2005 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 119 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0000 with negotiated timeout 10000 for client /140.211.11.196:18914
[junit4:junit4]   2> 119 T2007 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0000, negotiated timeout = 10000
[junit4:junit4]   2> 119 T2008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30d21291 name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 119 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 120 T2001 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 126 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0000
[junit4:junit4]   2> 128 T2008 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 128 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18914 which had sessionid 0x13d71cad3fb0000
[junit4:junit4]   2> 128 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0000 closed
[junit4:junit4]   2> 129 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@43ead6c1
[junit4:junit4]   2> 130 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 130 T2009 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 130 T2009 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 131 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18916
[junit4:junit4]   2> 131 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18916
[junit4:junit4]   2> 140 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0001 with negotiated timeout 10000 for client /140.211.11.196:18916
[junit4:junit4]   2> 140 T2009 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0001, negotiated timeout = 10000
[junit4:junit4]   2> 140 T2010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43ead6c1 name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 140 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 141 T2001 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 145 T2001 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 148 T2001 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 151 T2001 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 155 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 156 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 169 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 170 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 279 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 280 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 283 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 284 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 287 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 288 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 294 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 294 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 298 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 298 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 301 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 302 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 305 T2001 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 306 T2001 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 308 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0001
[junit4:junit4]   2> 316 T2010 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 316 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18916 which had sessionid 0x13d71cad3fb0001
[junit4:junit4]   2> 316 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0001 closed
[junit4:junit4]   2> 506 T2001 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 511 T2001 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:?????
[junit4:junit4]   2> 512 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 513 T2001 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 513 T2001 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083
[junit4:junit4]   2> 513 T2001 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/solr.xml
[junit4:junit4]   2> 514 T2001 oasc.CoreContainer.<init> New CoreContainer 391534428
[junit4:junit4]   2> 515 T2001 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/'
[junit4:junit4]   2> 515 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/'
[junit4:junit4]   2> 564 T2001 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 565 T2001 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 565 T2001 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 566 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 566 T2001 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 566 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 567 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 567 T2001 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 568 T2001 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 568 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 589 T2001 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 607 T2001 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18913/solr
[junit4:junit4]   2> 608 T2001 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 608 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@520cefa0
[junit4:junit4]   2> 609 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 610 T2020 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 611 T2020 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 611 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18918
[junit4:junit4]   2> 611 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18918
[junit4:junit4]   2> 613 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0002 with negotiated timeout 20000 for client /140.211.11.196:18918
[junit4:junit4]   2> 613 T2020 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0002, negotiated timeout = 20000
[junit4:junit4]   2> 614 T2021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@520cefa0 name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 614 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 615 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0002
[junit4:junit4]   2> 627 T2021 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 627 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18918 which had sessionid 0x13d71cad3fb0002
[junit4:junit4]   2> 627 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0002 closed
[junit4:junit4]   2> 628 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 639 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@10d3bd3c
[junit4:junit4]   2> 640 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 640 T2022 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 641 T2022 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 641 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18919
[junit4:junit4]   2> 641 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18919
[junit4:junit4]   2> 642 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0003 with negotiated timeout 20000 for client /140.211.11.196:18919
[junit4:junit4]   2> 642 T2022 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0003, negotiated timeout = 20000
[junit4:junit4]   2> 643 T2023 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10d3bd3c name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 643 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 645 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 653 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 656 T2001 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18917_p
[junit4:junit4]   2> 657 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18917_p Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18917_p
[junit4:junit4]   2> 659 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18917_p
[junit4:junit4]   2> 662 T2001 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 672 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 681 T2001 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 683 T2001 oasc.Overseer.start Overseer (id=89352683571052547-127.0.0.1:18917_p-n_0000000000) starting
[junit4:junit4]   2> 684 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 686 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 687 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 697 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 699 T2025 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 699 T2001 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 708 T2001 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 710 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 712 T2024 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 716 T2026 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/collection1
[junit4:junit4]   2> 716 T2026 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 717 T2026 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 717 T2026 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 718 T2026 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/collection1/'
[junit4:junit4]   2> 719 T2026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 720 T2026 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/collection1/lib/README' to classloader
[junit4:junit4]   2> 773 T2026 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 830 T2026 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 931 T2026 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 937 T2026 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1528 T2026 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1536 T2026 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1539 T2026 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1550 T2026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1554 T2026 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1557 T2026 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1557 T2026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1557 T2026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1558 T2026 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1558 T2026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1559 T2026 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1559 T2026 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1581 T2026 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363413751083/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/
[junit4:junit4]   2> 1581 T2026 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b2dd538
[junit4:junit4]   2> 1581 T2026 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1582 T2026 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data forceNew: false
[junit4:junit4]   2> 1583 T2026 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index/
[junit4:junit4]   2> 1583 T2026 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1584 T2026 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index forceNew: false
[junit4:junit4]   2> 1614 T2026 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1615 T2026 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1616 T2026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1616 T2026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1617 T2026 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1617 T2026 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1618 T2026 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1618 T2026 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1618 T2026 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1618 T2026 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1618 T2026 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1623 T2026 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1628 T2026 oass.SolrIndexSearcher.<init> Opening Searcher@502cc704 main
[junit4:junit4]   2> 1629 T2026 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1629 T2026 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1632 T2027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@502cc704 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1632 T2026 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1632 T2026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1633 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2215 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2215 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18917_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18917/p"}
[junit4:junit4]   2> 2216 T2024 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2216 T2024 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2216 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2265 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2645 T2026 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2645 T2026 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18917/p collection:control_collection shard:shard1
[junit4:junit4]   2> 2646 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2664 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2665 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2666 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2668 T2026 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2668 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2668 T2026 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18917/p/collection1/
[junit4:junit4]   2> 2669 T2026 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2669 T2026 oasc.SyncStrategy.syncToMe http://127.0.0.1:18917/p/collection1/ has no replicas
[junit4:junit4]   2> 2669 T2026 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18917/p/collection1/
[junit4:junit4]   2> 2669 T2026 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2673 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3777 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3813 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3848 T2026 oasc.ZkController.register We are http://127.0.0.1:18917/p/collection1/ and leader is http://127.0.0.1:18917/p/collection1/
[junit4:junit4]   2> 3848 T2026 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18917/p
[junit4:junit4]   2> 3848 T2026 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3848 T2026 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3848 T2026 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3850 T2026 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3851 T2001 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3852 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3853 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3865 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3867 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2b843a5f
[junit4:junit4]   2> 3868 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3868 T2029 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3868 T2029 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 3869 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18942
[junit4:junit4]   2> 3869 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18942
[junit4:junit4]   2> 3870 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0004 with negotiated timeout 10000 for client /140.211.11.196:18942
[junit4:junit4]   2> 3870 T2029 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0004, negotiated timeout = 10000
[junit4:junit4]   2> 3871 T2030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b843a5f name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3871 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3872 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3874 T2001 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4061 T2001 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4064 T2001 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:?????
[junit4:junit4]   2> 4065 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4065 T2001 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4065 T2001 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640
[junit4:junit4]   2> 4066 T2001 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/solr.xml
[junit4:junit4]   2> 4066 T2001 oasc.CoreContainer.<init> New CoreContainer 1191825981
[junit4:junit4]   2> 4067 T2001 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/'
[junit4:junit4]   2> 4067 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/'
[junit4:junit4]   2> 4113 T2001 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4113 T2001 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4114 T2001 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4114 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4115 T2001 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4115 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4116 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4116 T2001 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4116 T2001 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4117 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4134 T2001 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4151 T2001 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18913/solr
[junit4:junit4]   2> 4151 T2001 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4152 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3236dcd6
[junit4:junit4]   2> 4153 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4153 T2040 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4154 T2040 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 4154 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18944
[junit4:junit4]   2> 4155 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18944
[junit4:junit4]   2> 4157 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0005 with negotiated timeout 20000 for client /140.211.11.196:18944
[junit4:junit4]   2> 4157 T2040 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0005, negotiated timeout = 20000
[junit4:junit4]   2> 4157 T2041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3236dcd6 name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4157 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4158 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0005
[junit4:junit4]   2> 4174 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18944 which had sessionid 0x13d71cad3fb0005
[junit4:junit4]   2> 4174 T2041 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4174 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0005 closed
[junit4:junit4]   2> 4175 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4183 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c255913
[junit4:junit4]   2> 4184 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4184 T2042 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4185 T2042 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 4185 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18945
[junit4:junit4]   2> 4186 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18945
[junit4:junit4]   2> 4187 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0006 with negotiated timeout 20000 for client /140.211.11.196:18945
[junit4:junit4]   2> 4187 T2042 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0006, negotiated timeout = 20000
[junit4:junit4]   2> 4187 T2043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c255913 name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4188 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4188 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4194 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4197 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 5200 T2001 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18943_p
[junit4:junit4]   2> 5201 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18943_p Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18943_p
[junit4:junit4]   2> 5202 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18943_p
[junit4:junit4]   2> 5206 T2030 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5206 T2023 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5206 T2043 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5206 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5224 T2044 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/collection1
[junit4:junit4]   2> 5224 T2044 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5225 T2044 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5225 T2044 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5226 T2044 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/collection1/'
[junit4:junit4]   2> 5227 T2044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/collection1/lib/README' to classloader
[junit4:junit4]   2> 5228 T2044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5271 T2044 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 5323 T2044 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5326 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5327 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18917_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18917_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18917/p"}
[junit4:junit4]   2> 5341 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5341 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5424 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5424 T2044 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5430 T2044 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6013 T2044 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6021 T2044 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6024 T2044 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6036 T2044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6039 T2044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6042 T2044 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6043 T2044 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6044 T2044 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6044 T2044 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6045 T2044 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6045 T2044 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6046 T2044 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6046 T2044 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363413754640/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/
[junit4:junit4]   2> 6046 T2044 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b2dd538
[junit4:junit4]   2> 6046 T2044 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 6047 T2044 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1 forceNew: false
[junit4:junit4]   2> 6047 T2044 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index/
[junit4:junit4]   2> 6048 T2044 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6048 T2044 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index forceNew: false
[junit4:junit4]   2> 6053 T2044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6053 T2044 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6055 T2044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6055 T2044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6056 T2044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6056 T2044 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6057 T2044 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6057 T2044 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6057 T2044 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6057 T2044 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6058 T2044 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6062 T2044 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6067 T2044 oass.SolrIndexSearcher.<init> Opening Searcher@390982b7 main
[junit4:junit4]   2> 6068 T2044 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6068 T2044 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6071 T2045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@390982b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6072 T2044 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6072 T2044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6845 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 6846 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18943_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18943/p"}
[junit4:junit4]   2> 6846 T2024 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6846 T2024 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6875 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6875 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6875 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7075 T2044 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7075 T2044 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18943/p collection:collection1 shard:shard1
[junit4:junit4]   2> 7076 T2044 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7106 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7107 T2044 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 7107 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7118 T2044 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 7118 T2044 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 7118 T2044 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 7118 T2044 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 7118 T2044 oasc.SyncStrategy.syncToMe http://127.0.0.1:18943/p/collection1/ has no replicas
[junit4:junit4]   2> 7119 T2044 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 7119 T2044 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7123 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8387 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8407 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8407 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8407 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8460 T2044 oasc.ZkController.register We are http://127.0.0.1:18943/p/collection1/ and leader is http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 8460 T2044 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18943/p
[junit4:junit4]   2> 8460 T2044 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8460 T2044 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8460 T2044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8462 T2044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8463 T2001 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 8464 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8464 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8665 T2001 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8668 T2001 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:?????
[junit4:junit4]   2> 8669 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8670 T2001 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8670 T2001 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244
[junit4:junit4]   2> 8671 T2001 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/solr.xml
[junit4:junit4]   2> 8671 T2001 oasc.CoreContainer.<init> New CoreContainer 1688217352
[junit4:junit4]   2> 8672 T2001 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/'
[junit4:junit4]   2> 8672 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/'
[junit4:junit4]   2> 8722 T2001 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8722 T2001 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8723 T2001 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8723 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8724 T2001 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8724 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8725 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8725 T2001 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8726 T2001 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8726 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8747 T2001 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8765 T2001 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18913/solr
[junit4:junit4]   2> 8766 T2001 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8767 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3188fd80
[junit4:junit4]   2> 8768 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8768 T2056 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8769 T2056 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 8769 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18955
[junit4:junit4]   2> 8769 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18955
[junit4:junit4]   2> 8789 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0007 with negotiated timeout 20000 for client /140.211.11.196:18955
[junit4:junit4]   2> 8789 T2056 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0007, negotiated timeout = 20000
[junit4:junit4]   2> 8790 T2057 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3188fd80 name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8790 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8791 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0007
[junit4:junit4]   2> 8792 T2057 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8792 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18955 which had sessionid 0x13d71cad3fb0007
[junit4:junit4]   2> 8792 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0007 closed
[junit4:junit4]   2> 8793 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8803 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f8aff2d
[junit4:junit4]   2> 8805 T2058 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8804 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8805 T2058 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 8805 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18956
[junit4:junit4]   2> 8805 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18956
[junit4:junit4]   2> 8806 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0008 with negotiated timeout 20000 for client /140.211.11.196:18956
[junit4:junit4]   2> 8806 T2058 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0008, negotiated timeout = 20000
[junit4:junit4]   2> 8807 T2059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f8aff2d name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8807 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8808 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8809 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8818 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 9821 T2001 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18954_p
[junit4:junit4]   2> 9822 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18954_p Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18954_p
[junit4:junit4]   2> 9844 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18954_p
[junit4:junit4]   2> 9848 T2023 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9848 T2043 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9848 T2059 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9848 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9848 T2030 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9849 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9849 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9882 T2060 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/collection1
[junit4:junit4]   2> 9882 T2060 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9883 T2060 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9883 T2060 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9884 T2060 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/collection1/'
[junit4:junit4]   2> 9885 T2060 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/collection1/lib/README' to classloader
[junit4:junit4]   2> 9886 T2060 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9920 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 9921 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18943_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18943_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18943/p"}
[junit4:junit4]   2> 9927 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9927 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9927 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9927 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9935 T2060 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9997 T2060 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10098 T2060 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10104 T2060 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10705 T2060 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10716 T2060 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10720 T2060 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10733 T2060 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10738 T2060 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10742 T2060 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10743 T2060 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10744 T2060 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10744 T2060 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10745 T2060 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10745 T2060 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10745 T2060 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10746 T2060 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363413759244/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/
[junit4:junit4]   2> 10746 T2060 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b2dd538
[junit4:junit4]   2> 10746 T2060 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10747 T2060 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2 forceNew: false
[junit4:junit4]   2> 10748 T2060 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index/
[junit4:junit4]   2> 10748 T2060 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10749 T2060 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index forceNew: false
[junit4:junit4]   2> 10779 T2060 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10780 T2060 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10782 T2060 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10783 T2060 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10783 T2060 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10784 T2060 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10784 T2060 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10785 T2060 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10785 T2060 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10785 T2060 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10786 T2060 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10793 T2060 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10801 T2060 oass.SolrIndexSearcher.<init> Opening Searcher@46061658 main
[junit4:junit4]   2> 10802 T2060 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10802 T2060 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10806 T2061 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46061658 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10807 T2060 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10807 T2060 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11432 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11432 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18954_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18954/p"}
[junit4:junit4]   2> 11433 T2024 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11433 T2024 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11485 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11485 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11485 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11485 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11810 T2060 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11810 T2060 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18954/p collection:collection1 shard:shard1
[junit4:junit4]   2> 11813 T2060 oasc.ZkController.register We are http://127.0.0.1:18954/p/collection1/ and leader is http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 11814 T2060 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18954/p
[junit4:junit4]   2> 11814 T2060 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11814 T2060 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C98 name=collection1 org.apache.solr.core.SolrCore@5f8c5bac url=http://127.0.0.1:18954/p/collection1 node=127.0.0.1:18954_p C98_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18954_p, base_url=http://127.0.0.1:18954/p}
[junit4:junit4]   2> 11814 T2062 C98 P18954 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11815 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11816 T2062 C98 P18954 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11816 T2060 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11816 T2062 C98 P18954 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11817 T2001 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 11818 T2062 C98 P18954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11818 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11818 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12018 T2001 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12021 T2001 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:?????
[junit4:junit4]   2> 12021 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12022 T2001 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12022 T2001 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599
[junit4:junit4]   2> 12023 T2001 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/solr.xml
[junit4:junit4]   2> 12023 T2001 oasc.CoreContainer.<init> New CoreContainer 1550320739
[junit4:junit4]   2> 12024 T2001 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/'
[junit4:junit4]   2> 12024 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/'
[junit4:junit4]   2> 12074 T2001 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 12074 T2001 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12075 T2001 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12075 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12076 T2001 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12076 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12077 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12077 T2001 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12078 T2001 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12078 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12097 T2001 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12115 T2001 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18913/solr
[junit4:junit4]   2> 12116 T2001 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12116 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@75d43833
[junit4:junit4]   2> 12117 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12118 T2073 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12119 T2073 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 12119 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18966
[junit4:junit4]   2> 12119 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18966
[junit4:junit4]   2> 12121 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb0009 with negotiated timeout 20000 for client /140.211.11.196:18966
[junit4:junit4]   2> 12121 T2073 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb0009, negotiated timeout = 20000
[junit4:junit4]   2> 12122 T2074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75d43833 name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12122 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12123 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb0009
[junit4:junit4]   2> 12133 T2074 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12133 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18966 which had sessionid 0x13d71cad3fb0009
[junit4:junit4]   2> 12133 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb0009 closed
[junit4:junit4]   2> 12133 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 12142 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@174f8480
[junit4:junit4]   2> 12143 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12143 T2075 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 12144 T2075 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 12144 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18967
[junit4:junit4]   2> 12144 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18967
[junit4:junit4]   2> 12146 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb000a with negotiated timeout 20000 for client /140.211.11.196:18967
[junit4:junit4]   2> 12146 T2075 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb000a, negotiated timeout = 20000
[junit4:junit4]   2> 12146 T2076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@174f8480 name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12146 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12147 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12149 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12158 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 12990 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12991 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18954_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18954_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18954/p"}
[junit4:junit4]   2> 13032 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13032 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13032 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13032 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13032 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13161 T2001 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18965_p
[junit4:junit4]   2> 13162 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18965_p Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18965_p
[junit4:junit4]   2> 13164 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18965_p
[junit4:junit4]   2> 13166 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13166 T2023 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13166 T2076 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13166 T2043 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13166 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13167 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13166 T2030 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13167 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13167 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 13167 T2059 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 13181 T2077 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/collection1
[junit4:junit4]   2> 13182 T2077 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 13182 T2077 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 13182 T2077 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 13183 T2077 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/collection1/'
[junit4:junit4]   2> 13185 T2077 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 13185 T2077 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/collection1/lib/README' to classloader
[junit4:junit4]   2> 13238 T2077 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 13295 T2077 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13396 T2077 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13405 T2077 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13836 T2033 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:18954_p_collection1&state=recovering&nodeName=127.0.0.1:18954_p&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4]   2> 14015 T2077 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14023 T2077 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14026 T2077 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14036 T2077 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14040 T2077 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14043 T2077 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14044 T2077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14044 T2077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14045 T2077 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14045 T2077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14045 T2077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14046 T2077 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 14046 T2077 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363413762599/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/
[junit4:junit4]   2> 14046 T2077 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b2dd538
[junit4:junit4]   2> 14046 T2077 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 14047 T2077 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3 forceNew: false
[junit4:junit4]   2> 14047 T2077 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index/
[junit4:junit4]   2> 14048 T2077 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14048 T2077 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index forceNew: false
[junit4:junit4]   2> 14053 T2077 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14053 T2077 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14055 T2077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14055 T2077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14055 T2077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14056 T2077 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14056 T2077 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14056 T2077 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14056 T2077 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14057 T2077 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14057 T2077 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14062 T2077 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14067 T2077 oass.SolrIndexSearcher.<init> Opening Searcher@701e19ad main
[junit4:junit4]   2> 14068 T2077 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14068 T2077 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14070 T2078 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@701e19ad main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14072 T2077 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14072 T2077 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14537 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 14538 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18965_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18965/p"}
[junit4:junit4]   2> 14538 T2024 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14538 T2024 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14543 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14543 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14543 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14543 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14543 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15074 T2077 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15074 T2077 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18965/p collection:collection1 shard:shard1
[junit4:junit4]   2> 15078 T2077 oasc.ZkController.register We are http://127.0.0.1:18965/p/collection1/ and leader is http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 15078 T2077 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18965/p
[junit4:junit4]   2> 15078 T2077 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 15078 T2077 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@44c78091 url=http://127.0.0.1:18965/p/collection1 node=127.0.0.1:18965_p C99_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18965_p, base_url=http://127.0.0.1:18965/p}
[junit4:junit4]   2> 15079 T2079 C99 P18965 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 15079 T2077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 15080 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 15080 T2079 C99 P18965 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 15080 T2079 C99 P18965 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15081 T2001 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 15081 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15082 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15102 T2079 C99 P18965 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15288 T2001 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 15291 T2001 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:?????
[junit4:junit4]   2> 15292 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 15292 T2001 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 15293 T2001 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861
[junit4:junit4]   2> 15293 T2001 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/solr.xml
[junit4:junit4]   2> 15294 T2001 oasc.CoreContainer.<init> New CoreContainer 1005547847
[junit4:junit4]   2> 15294 T2001 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/'
[junit4:junit4]   2> 15295 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/'
[junit4:junit4]   2> 15345 T2001 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 15346 T2001 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 15346 T2001 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 15346 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 15347 T2001 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 15347 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 15348 T2001 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 15348 T2001 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 15349 T2001 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 15349 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 15370 T2001 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15388 T2001 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:18913/solr
[junit4:junit4]   2> 15389 T2001 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15389 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@554ff7ea
[junit4:junit4]   2> 15390 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15391 T2090 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15391 T2090 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 15392 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18974
[junit4:junit4]   2> 15392 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18974
[junit4:junit4]   2> 15394 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb000b with negotiated timeout 20000 for client /140.211.11.196:18974
[junit4:junit4]   2> 15395 T2090 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb000b, negotiated timeout = 20000
[junit4:junit4]   2> 15395 T2091 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@554ff7ea name:ZooKeeperConnection Watcher:127.0.0.1:18913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15395 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15396 T2006 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d71cad3fb000b
[junit4:junit4]   2> 15406 T2091 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15406 T2003 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:18974 which had sessionid 0x13d71cad3fb000b
[junit4:junit4]   2> 15406 T2001 oaz.ZooKeeper.close Session: 0x13d71cad3fb000b closed
[junit4:junit4]   2> 15407 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 15418 T2001 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:18913/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2b83a820
[junit4:junit4]   2> 15418 T2001 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15419 T2092 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:18913. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15419 T2092 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:18913, initiating session
[junit4:junit4]   2> 15420 T2003 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:18975
[junit4:junit4]   2> 15420 T2003 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:18975
[junit4:junit4]   2> 15426 T2005 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d71cad3fb000c with negotiated timeout 20000 for client /140.211.11.196:18975
[junit4:junit4]   2> 15426 T2092 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:18913, sessionid = 0x13d71cad3fb000c, negotiated timeout = 20000
[junit4:junit4]   2> 15426 T2093 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b83a820 name:ZooKeeperConnection Watcher:127.0.0.1:18913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15427 T2001 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15427 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15532 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15534 T2001 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2>  C98_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18954_p, base_url=http://127.0.0.1:18954/p}
[junit4:junit4]   2> 15838 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:18943/p/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15838 T2062 C98 P18954 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18954/p START replicas=[http://127.0.0.1:18943/p/collection1/] nUpdates=100
[junit4:junit4]   2> 15838 T2062 C98 P18954 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15839 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15839 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15839 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15840 T2062 C98 P18954 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15840 T2062 C98 P18954 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:18943/p/collection1/. core=collection1
[junit4:junit4]   2> 15840 T2062 C98 P18954 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@3d478b91 url=http://127.0.0.1:18943/p/collection1 node=127.0.0.1:18943_p C100_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18943_p, base_url=http://127.0.0.1:18943/p, leader=true}
[junit4:junit4]   2> 15847 T2035 C100 P18943 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4]   2> 15853 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 15857 T2036 C100 P18943 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15858 T2036 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15863 T2036 C100 P18943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15864 T2036 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15865 T2036 C100 P18943 oass.SolrIndexSearcher.<init> Opening Searcher@28fe998a realtime
[junit4:junit4]   2> 15865 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15866 T2036 C100 P18943 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4]   2> 15867 T2062 C98 P18954 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15867 T2062 C98 P18954 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15869 T2037 C100 P18943 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15870 T2037 C100 P18943 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 15870 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 15870 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15871 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15874 T2037 C100 P18943 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4]   2> 15874 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15875 T2062 C98 P18954 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index.20130316060246641 forceNew: false
[junit4:junit4]   2> 15877 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index.20130316060246641 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70489ac6; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 15880 T2037 C100 P18943 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4]   2> 15887 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15890 T2062 C98 P18954 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15890 T2062 C98 P18954 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15894 T2062 C98 P18954 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15895 T2062 C98 P18954 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15895 T2062 C98 P18954 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15896 T2062 C98 P18954 oass.SolrIndexSearcher.<init> Opening Searcher@66271f62 main
[junit4:junit4]   2> 15897 T2061 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66271f62 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 15898 T2062 C98 P18954 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index.20130316060246641 lockFactory=org.apache.lucene.store.NativeFSLockFactory@70489ac6; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 15899 T2062 C98 P18954 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15899 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15899 T2062 C98 P18954 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15900 T2062 C98 P18954 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15901 T2062 C98 P18954 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 16059 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 16060 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18965_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18965_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18965/p"}
[junit4:junit4]   2> 16068 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18954_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18954_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18954/p"}
[junit4:junit4]   2> 16077 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16077 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16077 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16077 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16077 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16077 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16113 T2034 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:18965_p_collection1&state=recovering&nodeName=127.0.0.1:18965_p&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4]   2> 16537 T2001 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18972_p
[junit4:junit4]   2> 16538 T2006 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d71cad3fb000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18972_p Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18972_p
[junit4:junit4]   2> 16540 T2001 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18972_p
[junit4:junit4]   2> 16542 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16543 T2043 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16543 T2023 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16543 T2076 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16543 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16543 T2093 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16543 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16543 T2030 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16544 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16543 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16544 T2059 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16544 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16567 T2096 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/collection1
[junit4:junit4]   2> 16567 T2096 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16568 T2096 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16568 T2096 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16569 T2096 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/collection1/'
[junit4:junit4]   2> 16570 T2096 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/collection1/lib/README' to classloader
[junit4:junit4]   2> 16571 T2096 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16637 T2096 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 16693 T2096 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16793 T2096 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16799 T2096 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17399 T2096 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17410 T2096 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17414 T2096 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17428 T2096 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17433 T2096 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17437 T2096 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17438 T2096 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17439 T2096 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17439 T2096 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17440 T2096 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 17440 T2096 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 17441 T2096 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 17441 T2096 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363413765861/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/
[junit4:junit4]   2> 17441 T2096 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b2dd538
[junit4:junit4]   2> 17442 T2096 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 17443 T2096 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4 forceNew: false
[junit4:junit4]   2> 17443 T2096 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index/
[junit4:junit4]   2> 17444 T2096 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17445 T2096 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index forceNew: false
[junit4:junit4]   2> 17476 T2096 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17476 T2096 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17479 T2096 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17479 T2096 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17480 T2096 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17480 T2096 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17481 T2096 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17481 T2096 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17481 T2096 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17482 T2096 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17482 T2096 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17490 T2096 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17497 T2096 oass.SolrIndexSearcher.<init> Opening Searcher@292d3d92 main
[junit4:junit4]   2> 17497 T2096 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17498 T2096 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17501 T2097 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@292d3d92 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17503 T2096 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17503 T2096 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17589 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17590 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18972_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18972/p"}
[junit4:junit4]   2> 17590 T2024 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 17591 T2024 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17603 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17603 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17603 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17603 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17603 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17604 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18965_p, base_url=http://127.0.0.1:18965/p}
[junit4:junit4]   2> 18114 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:18943/p/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18114 T2079 C99 P18965 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18965/p START replicas=[http://127.0.0.1:18943/p/collection1/] nUpdates=100
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18115 T2079 C99 P18965 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:18943/p/collection1/. core=collection1
[junit4:junit4]   2> 18116 T2079 C99 P18965 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18117 T2035 C100 P18943 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 18130 T2038 C100 P18943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 18137 T2038 C100 P18943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18138 T2038 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18140 T2038 C100 P18943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18140 T2038 C100 P18943 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2> 18142 T2079 C99 P18965 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18142 T2079 C99 P18965 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18144 T2037 C100 P18943 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 18145 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 18145 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18145 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18148 T2037 C100 P18943 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4]   2> 18148 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18149 T2079 C99 P18965 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index.20130316060248914 forceNew: false
[junit4:junit4]   2> 18150 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index.20130316060248914 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23236f88; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 18153 T2037 C100 P18943 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4]   2> 18154 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18156 T2079 C99 P18965 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18157 T2079 C99 P18965 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18160 T2079 C99 P18965 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18161 T2079 C99 P18965 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18161 T2079 C99 P18965 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18162 T2079 C99 P18965 oass.SolrIndexSearcher.<init> Opening Searcher@38795441 main
[junit4:junit4]   2> 18163 T2078 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38795441 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 18163 T2079 C99 P18965 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index.20130316060248914 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23236f88; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 18165 T2079 C99 P18965 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 18165 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 18165 T2079 C99 P18965 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 18165 T2079 C99 P18965 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18167 T2079 C99 P18965 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 18505 T2096 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18505 T2096 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18972/p collection:collection1 shard:shard1
[junit4:junit4]   2> 18508 T2096 oasc.ZkController.register We are http://127.0.0.1:18972/p/collection1/ and leader is http://127.0.0.1:18943/p/collection1/
[junit4:junit4]   2> 18509 T2096 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18972/p
[junit4:junit4]   2> 18509 T2096 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 18509 T2096 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@2c71e181 url=http://127.0.0.1:18972/p/collection1 node=127.0.0.1:18972_p C101_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18972_p, base_url=http://127.0.0.1:18972/p}
[junit4:junit4]   2> 18510 T2100 C101 P18972 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 18510 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 18510 T2100 C101 P18972 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 18511 T2096 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 18511 T2100 C101 P18972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18512 T2001 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 18512 T2001 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 18513 T2100 C101 P18972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18513 T2001 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18536 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 18538 T2001 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 18538 T2001 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 18539 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 19107 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 19108 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18965_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18965_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18965/p"}
[junit4:junit4]   2> 19130 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18972_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18972_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18972/p"}
[junit4:junit4]   2> 19143 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19143 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19143 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19143 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19143 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19143 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19538 T2039 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:18972_p_collection1&state=recovering&nodeName=127.0.0.1:18972_p&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4]   2> 19541 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 20543 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18972_p, base_url=http://127.0.0.1:18972/p}
[junit4:junit4]   2> 21540 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:18943/p/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 21540 T2100 C101 P18972 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18972/p START replicas=[http://127.0.0.1:18943/p/collection1/] nUpdates=100
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 21541 T2100 C101 P18972 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:18943/p/collection1/. core=collection1
[junit4:junit4]   2> 21542 T2100 C101 P18972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21543 T2035 C100 P18943 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 21545 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 21552 T2033 C100 P18943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 21582 T2033 C100 P18943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21582 T2033 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21583 T2033 C100 P18943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 21584 T2033 C100 P18943 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4]   2> 21584 T2100 C101 P18972 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 21585 T2100 C101 P18972 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 21587 T2037 C100 P18943 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 21588 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 21588 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 21588 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 21591 T2037 C100 P18943 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4]   2> 21591 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 21592 T2100 C101 P18972 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index.20130316060252358 forceNew: false
[junit4:junit4]   2> 21594 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index.20130316060252358 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ab1b427; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 21597 T2037 C100 P18943 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4]   2> 21598 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 21600 T2100 C101 P18972 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 21601 T2100 C101 P18972 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 21605 T2100 C101 P18972 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21605 T2100 C101 P18972 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21606 T2100 C101 P18972 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 21607 T2100 C101 P18972 oass.SolrIndexSearcher.<init> Opening Searcher@4cc190af main
[junit4:junit4]   2> 21607 T2097 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4cc190af main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 21608 T2100 C101 P18972 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index.20130316060252358 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ab1b427; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 21609 T2100 C101 P18972 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 21609 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 21610 T2100 C101 P18972 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 21610 T2100 C101 P18972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 21611 T2100 C101 P18972 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 22158 T2024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22159 T2024 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:18972_p_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:18972_p",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:18972/p"}
[junit4:junit4]   2> 22182 T2043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22182 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22182 T2030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22182 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22182 T2076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22182 T2023 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22547 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22548 T2001 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@7c1d481e url=http://127.0.0.1:18917/p/collection1 node=127.0.0.1:18917_p C102_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:18917_p, base_url=http://127.0.0.1:18917/p, leader=true}
[junit4:junit4]   2> 22558 T2013 C102 P18917 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22563 T2013 C102 P18917 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22564 T2013 C102 P18917 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22568 T2013 C102 P18917 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22569 T2013 C102 P18917 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22572 T2013 C102 P18917 oass.SolrIndexSearcher.<init> Opening Searcher@60ca1a22 main
[junit4:junit4]   2> 22573 T2013 C102 P18917 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22573 T2027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60ca1a22 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22574 T2013 C102 P18917 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4]   2> 22584 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22588 T2036 C100 P18943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22588 T2036 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22589 T2036 C100 P18943 oass.SolrIndexSearcher.<init> Opening Searcher@34d05c67 main
[junit4:junit4]   2> 22590 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22591 T2045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34d05c67 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22591 T2036 C100 P18943 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:18954/p/collection1/, StdNode: http://127.0.0.1:18965/p/collection1/, StdNode: http://127.0.0.1:18972/p/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C98_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18954_p, base_url=http://127.0.0.1:18954/p}
[junit4:junit4]   2> 22604 T2049 C98 P18954 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18965_p, base_url=http://127.0.0.1:18965/p}
[junit4:junit4]   2> 22605 T2066 C99 P18965 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18972_p, base_url=http://127.0.0.1:18972/p}
[junit4:junit4]   2> 22605 T2083 C101 P18972 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22619 T2049 C98 P18954 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 22620 T2049 C98 P18954 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 22622 T2049 C98 P18954 oass.SolrIndexSearcher.<init> Opening Searcher@78193f72 main
[junit4:junit4]   2> 22622 T2049 C98 P18954 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22623 T2061 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78193f72 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22623 T2049 C98 P18954 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4]   2> 22626 T2066 C99 P18965 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22627 T2066 C99 P18965 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22627 T2083 C101 P18972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22627 T2083 C101 P18972 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22628 T2066 C99 P18965 oass.SolrIndexSearcher.<init> Opening Searcher@13cb7c4 main
[junit4:junit4]   2> 22629 T2066 C99 P18965 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22629 T2083 C101 P18972 oass.SolrIndexSearcher.<init> Opening Searcher@49cd1091 main
[junit4:junit4]   2> 22629 T2078 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13cb7c4 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 22630 T2083 C101 P18972 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22630 T2066 C99 P18965 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4]   2> 22630 T2097 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49cd1091 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 22631 T2083 C101 P18972 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4]   2> 22631 T2036 C100 P18943 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4]   2> 22632 T2001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22635 T2034 C100 P18943 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 22637 T2050 C98 P18954 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 22638 T2067 C99 P18965 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 22640 T2084 C101 P18972 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 24645 T2013 C102 P18917 oass.SolrIndexSearcher.<init> Opening Searcher@2fcf763c realtime
[junit4:junit4]   2> 24646 T2013 C102 P18917 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429642962964316160)} 0 3
[junit4:junit4]   2> 24654 T2083 C101 P18972 /update {update.distrib=FROMLEADER&_version_=-1429642962969559040&update.from=http://127.0.0.1:18943/p/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429642962969559040)} 0 1
[junit4:junit4]   2> 24655 T2066 C99 P18965 /update {update.distrib=FROMLEADER&_version_=-1429642962969559040&update.from=http://127.0.0.1:18943/p/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429642962969559040)} 0 2
[junit4:junit4]   2> 24655 T2049 C98 P18954 /update {update.distrib=FROMLEADER&_version_=-1429642962969559040&update.from=http://127.0.0.1:18943/p/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429642962969559040)} 0 2
[junit4:junit4]   2> 24656 T2036 C100 P18943 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429642962969559040)} 0 7
[junit4:junit4]   2> 24660 T2013 C102 P18917 /update {wt=javabin&version=2} {add=[0 (1429642962978996224)]} 0 2
[junit4:junit4]   2> 24670 T2083 C101 P18972 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429642962984239104)]} 0 2
[junit4:junit4]   2> 24670 T2066 C99 P18965 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429642962984239104)]} 0 2
[junit4:junit4]   2> 24670 T2049 C98 P18954 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429642962984239104)]} 0 2
[junit4:junit4]   2> 24671 T2036 C100 P18943 /update {wt=javabin&version=2} {add=[0 (1429642962984239104)]} 0 8
[junit4:junit4]   2> 24675 T2013 C102 P18917 /update {wt=javabin&version=2} {add=[1 (1429642962995773440)]} 0 1
[junit4:junit4]   2> 24681 T2066 C99 P18965 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429642962998919168)]} 0 1
[junit4:junit4]   2> 24681 T2083 C101 P18972 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429642962998919168)]} 0 1
[junit4:junit4]   2> 24681 T2049 C98 P18954 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429642962998919168)]} 0 1
[junit4:junit4]   2> 24682 T2036 C100 P18943 /update {wt=javabin&version=2} {add=[1 (1429642962998919168)]} 0 5
[junit4:junit4]   2> 24685 T2013 C102 P18917 /update {wt=javabin&version=2} {add=[2 (1429642963006259200)]} 0 1
[junit4:junit4]   2> 24691 T2083 C101 P18972 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429642963009404928)]} 0 1
[junit4:junit4]   2> 24691 T2066 C99 P18965 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429642963009404928)]} 0 1
[junit4:junit4]   2> 24691 T2036 C100 P18943 /update {test.distrib.skip.servers=http://127.0.0.1:18954/p/collection1/&wt=javabin&version=2} {add=[2 (1429642963009404928)]} 0 4
[junit4:junit4]   2> 24695 T2013 C102 P18917 /update {wt=javabin&version=2} {add=[3 (1429642963016744960)]} 0 1
[junit4:junit4]   2> 24701 T2083 C101 P18972 /update {distrib.from=http://127.0.0.1:18943/p/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429642963019890688)]} 0 1
[junit4:junit4]   2> 24701 T2036 C100 P18943 /update {test.distrib.skip.servers=http://127.0.0.1:18954/p/collection1/&test.distrib.skip.servers=http://127.0.0.1:18965/p/collection1/&wt=javabin&version=2} {add=[3 (1429642963019890688)]} 0 4
[junit4:junit4]   2> 24704 T2013 C102 P18917 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24831 T2013 C102 P18917 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@19224058; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4]   2> 24832 T2013 C102 P18917 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4]   2> 24839 T2013 C102 P18917 oass.SolrIndexSearcher.<init> Opening Searcher@3f6c49fb main
[junit4:junit4]   2> 24839 T2013 C102 P18917 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24840 T2027 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f6c49fb main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4]   2> 24840 T2013 C102 P18917 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 136
[junit4:junit4]   2> 24843 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24903 T2036 C100 P18943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@67f3411; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   2> 24904 T2036 C100 P18943 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   2> 24910 T2036 C100 P18943 oass.SolrIndexSearcher.<init> Opening Searcher@88aa21a main
[junit4:junit4]   2> 24910 T2036 C100 P18943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 24911 T2045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@88aa21a main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4]   2> 24912 T2036 C100 P18943 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:18954/p/collection1/, StdNode: http://127.0.0.1:18965/p/collection1/, StdNode: http://127.0.0.1:18972/p/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 24914 T2049 C98 P18954 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24915 T2066 C99 P18965 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 24915 T2083 C101 P18972 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25013 T2049 C98 P18954 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50217b88; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_4]
[junit4:junit4]   2> 25013 T2066 C99 P18965 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1db63eeb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, segments_5, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   2> 25014 T2049 C98 P18954 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_4]
[junit4:junit4]   2> 25014 T2066 C99 P18965 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0.nvd, _0.fdx, _0.si, _0.nvm, segments_5, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4]   2> 25014 T2083 C101 P18972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ac81776; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[j

[...truncated too long message...]

ooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2>
[junit4:junit4]   2> 132337 T2076 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 133394 T2093 oasu.PeerSync.handleResponse WARNING PeerSync: core=collection1 url=http://127.0.0.1:18972/p  couldn't connect to http://127.0.0.1:18965/p/collection1/, counting as success
[junit4:junit4]   2> 133394 T2093 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18972/p DONE. sync succeeded
[junit4:junit4]   2> 133395 T2093 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4]   2> 133395 T2093 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4]   2> 133395 T2093 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2c71e181
[junit4:junit4]   2> 133396 T2093 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4]   2> 133397 T2093 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 133397 T2093 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 133397 T2093 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 133397 T2093 C101 P18972 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/tlog/tlog.0000000000000000003 refcount=1}
[junit4:junit4]   2> 133398 T2093 C101 P18972 oasu.TransactionLog.forceClose SEVERE Error: Forcing close of tlog{file=./org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/tlog/tlog.0000000000000000001 refcount=1}
[junit4:junit4]   2> 133400 T2093 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 133429 T2093 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4
[junit4:junit4]   2> 133430 T2093 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4
[junit4:junit4]   2> 133430 T2093 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index.20130316060252358
[junit4:junit4]   2> 133430 T2093 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index.20130316060252358
[junit4:junit4]   2> 133430 T2093 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index
[junit4:junit4]   2> 133430 T2093 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363413750772/jetty4/index
[junit4:junit4]   2> 133431 T2093 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 133431 T2093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 133431 T2093 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 133431 T2093 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2>
[junit4:junit4]   2> 133432 T2093 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=383), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=383)), sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=hi_IN, timezone=Etc/GMT
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=4,free=148257720,total=447348736
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestValueSourceCache, IndexSchemaTest, TestJoin, TestXIncludeConfig, DistributedTermsComponentTest, SolrCoreTest, FastVectorHighlighterTest, UnloadDistributedZkTest, MinimalSchemaTest, TestReversedWildcardFilterFactory, SearchHandlerTest, CircularListTest, TestRealTimeGet, CachingDirectoryFactoryTest, PolyFieldTest, ScriptEngineTest, TestRandomDVFaceting, TestPHPSerializedResponseWriter, TermVectorComponentTest, TestTrie, TestDocumentBuilder, TestWriterPerf, SolrInfoMBeanTest, TestFaceting, AnalysisAfterCoreReloadTest, LoggingHandlerTest, TestCopyFieldCollectionResource, TestDocSet, TestCoreContainer, RegexBoostProcessorTest, CSVRequestHandlerTest, ExternalFileFieldSortTest, WordBreakSolrSpellCheckerTest, ResponseLogComponentTest, TestGroupingSearch, SliceStateUpdateTest, TestSurroundQueryParser, TestPropInjectDefaults, SliceStateTest, TestSolrCoreProperties, PeerSyncTest, DirectUpdateHandlerOptimizeTest, UUIDFieldTest, TermsComponentTest, TestConfig, SOLR749Test, PluginInfoTest, TestStressVersions, TestExtendedDismaxParser, MBeansHandlerTest, PrimitiveFieldTypeTest, UpdateRequestProcessorFactoryTest, TestRemoteStreaming, TestCharFilters, CacheHeaderTest, TestStressRecovery, TestCollationKeyRangeQueries, BinaryUpdateRequestHandlerTest, RecoveryZkTest, RAMDirectoryFactoryTest, TestSort, TestPerFieldSimilarity, LeaderElectionTest, TestFuzzyAnalyzedSuggestions, TestLMDirichletSimilarityFactory, SuggesterTest, CoreAdminHandlerTest, BasicDistributedZkTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 133.75s, 1 test, 1 failure <<< FAILURES!

[...truncated 450 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 27 ignored (8 assumptions)

Total time: 49 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1427 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1427/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:16199/v/f/collection1 Dead Guy:http://127.0.0.1:50387/v/f/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:48068/v/f/collection1], CloudJettyRunner [url=http://127.0.0.1:40057/v/f/collection1]]

Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:16199/v/f/collection1 Dead Guy:http://127.0.0.1:50387/v/f/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:48068/v/f/collection1], CloudJettyRunner [url=http://127.0.0.1:40057/v/f/collection1]]
        at __randomizedtesting.SeedInfo.seed([63E02CC8101653DD:E206A2D0674933E1]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 8763 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T2504 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /v/f
[junit4:junit4]   2> 5 T2504 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1363452741918
[junit4:junit4]   2> 7 T2504 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T2505 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T2505 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 10 T2505 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 10 T2505 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T2505 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T2505 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1363452741918/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T2504 oasc.ZkTestServer.run start zk server on port:14773
[junit4:junit4]   2> 108 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c3dd238
[junit4:junit4]   2> 109 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 110 T2510 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 110 T2510 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 111 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:62410
[junit4:junit4]   2> 111 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:62410
[junit4:junit4]   2> 111 T2508 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 114 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250000 with negotiated timeout 10000 for client /140.211.11.196:62410
[junit4:junit4]   2> 114 T2510 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250000, negotiated timeout = 10000
[junit4:junit4]   2> 114 T2511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c3dd238 name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 114 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 115 T2504 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 117 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250000
[junit4:junit4]   2> 126 T2511 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 127 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:62410 which had sessionid 0x13d741dc9250000
[junit4:junit4]   2> 126 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250000 closed
[junit4:junit4]   2> 127 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6090004
[junit4:junit4]   2> 128 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 128 T2512 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 129 T2512 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 129 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30720
[junit4:junit4]   2> 129 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30720
[junit4:junit4]   2> 130 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250001 with negotiated timeout 10000 for client /140.211.11.196:30720
[junit4:junit4]   2> 130 T2512 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250001, negotiated timeout = 10000
[junit4:junit4]   2> 130 T2513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6090004 name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 131 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 131 T2504 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 135 T2504 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 144 T2504 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 146 T2504 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 149 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 150 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 162 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 163 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 167 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 168 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 171 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 171 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 183 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 184 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 187 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 187 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 191 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 191 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 194 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 195 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 198 T2504 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 198 T2504 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 201 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250001
[junit4:junit4]   2> 202 T2513 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 202 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250001 closed
[junit4:junit4]   2> 202 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:30720 which had sessionid 0x13d741dc9250001
[junit4:junit4]   2> 387 T2504 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 392 T2504 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:41196
[junit4:junit4]   2> 392 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 393 T2504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 393 T2504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115
[junit4:junit4]   2> 394 T2504 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/solr.xml
[junit4:junit4]   2> 394 T2504 oasc.CoreContainer.<init> New CoreContainer 1274164364
[junit4:junit4]   2> 395 T2504 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/'
[junit4:junit4]   2> 396 T2504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/'
[junit4:junit4]   2> 448 T2504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 449 T2504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 449 T2504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 450 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 450 T2504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 451 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 451 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 452 T2504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 452 T2504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 452 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 472 T2504 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 490 T2504 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:14773/solr
[junit4:junit4]   2> 491 T2504 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 491 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@65133cea
[junit4:junit4]   2> 492 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 493 T2523 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 494 T2523 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 494 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:12091
[junit4:junit4]   2> 494 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:12091
[junit4:junit4]   2> 496 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250002 with negotiated timeout 20000 for client /140.211.11.196:12091
[junit4:junit4]   2> 496 T2523 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250002, negotiated timeout = 20000
[junit4:junit4]   2> 496 T2524 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65133cea name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 497 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 498 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250002
[junit4:junit4]   2> 528 T2524 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 528 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:12091 which had sessionid 0x13d741dc9250002
[junit4:junit4]   2> 528 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250002 closed
[junit4:junit4]   2> 529 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 538 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6558493e
[junit4:junit4]   2> 539 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 540 T2525 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 540 T2525 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 540 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59054
[junit4:junit4]   2> 541 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59054
[junit4:junit4]   2> 542 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250003 with negotiated timeout 20000 for client /140.211.11.196:59054
[junit4:junit4]   2> 542 T2525 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250003, negotiated timeout = 20000
[junit4:junit4]   2> 543 T2526 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6558493e name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 543 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 574 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 576 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 579 T2504 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41196_v%2Ff
[junit4:junit4]   2> 579 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41196_v%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41196_v%2Ff
[junit4:junit4]   2> 618 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41196_v%2Ff
[junit4:junit4]   2> 621 T2504 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 656 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 662 T2504 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 664 T2504 oasc.Overseer.start Overseer (id=89355238894796803-127.0.0.1:41196_v%2Ff-n_0000000000) starting
[junit4:junit4]   2> 665 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 666 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 674 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 675 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 677 T2528 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 678 T2504 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 692 T2504 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 694 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 696 T2527 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 700 T2529 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/collection1
[junit4:junit4]   2> 700 T2529 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 701 T2529 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 701 T2529 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 702 T2529 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/collection1/'
[junit4:junit4]   2> 703 T2529 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/collection1/lib/README' to classloader
[junit4:junit4]   2> 704 T2529 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 750 T2529 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 810 T2529 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 812 T2529 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 818 T2529 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1415 T2529 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1426 T2529 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1430 T2529 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1443 T2529 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1447 T2529 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1452 T2529 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1453 T2529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1453 T2529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1453 T2529 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1454 T2529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1454 T2529 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1455 T2529 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1488 T2529 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363452742115/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/
[junit4:junit4]   2> 1488 T2529 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ebafdff
[junit4:junit4]   2> 1488 T2529 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1489 T2529 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data forceNew: false
[junit4:junit4]   2> 1490 T2529 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index/
[junit4:junit4]   2> 1491 T2529 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1492 T2529 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index forceNew: false
[junit4:junit4]   2> 1498 T2529 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1498 T2529 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1501 T2529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1501 T2529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1502 T2529 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1502 T2529 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1503 T2529 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1503 T2529 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1503 T2529 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1504 T2529 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1504 T2529 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1511 T2529 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1519 T2529 oass.SolrIndexSearcher.<init> Opening Searcher@779c6eb5 main
[junit4:junit4]   2> 1519 T2529 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1520 T2529 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1523 T2530 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@779c6eb5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1524 T2529 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1525 T2529 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1525 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2199 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2200 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:41196_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:41196/v/f"}
[junit4:junit4]   2> 2200 T2527 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2200 T2527 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2201 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2218 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2538 T2529 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2538 T2529 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41196/v/f collection:control_collection shard:shard1
[junit4:junit4]   2> 2539 T2529 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2556 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2557 T2529 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2557 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2559 T2529 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2559 T2529 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2560 T2529 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41196/v/f/collection1/
[junit4:junit4]   2> 2560 T2529 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2560 T2529 oasc.SyncStrategy.syncToMe http://127.0.0.1:41196/v/f/collection1/ has no replicas
[junit4:junit4]   2> 2560 T2529 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41196/v/f/collection1/
[junit4:junit4]   2> 2560 T2529 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2564 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3722 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3744 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3790 T2529 oasc.ZkController.register We are http://127.0.0.1:41196/v/f/collection1/ and leader is http://127.0.0.1:41196/v/f/collection1/
[junit4:junit4]   2> 3790 T2529 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41196/v/f
[junit4:junit4]   2> 3790 T2529 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3790 T2529 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3790 T2529 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3792 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3793 T2504 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 3794 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3794 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3807 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3808 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d0a3354
[junit4:junit4]   2> 3809 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3810 T2532 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3810 T2532 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 3810 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16007
[junit4:junit4]   2> 3811 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16007
[junit4:junit4]   2> 3812 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250004 with negotiated timeout 10000 for client /140.211.11.196:16007
[junit4:junit4]   2> 3812 T2532 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250004, negotiated timeout = 10000
[junit4:junit4]   2> 3812 T2533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d0a3354 name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3812 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3814 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3816 T2504 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4003 T2504 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4006 T2504 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50387
[junit4:junit4]   2> 4007 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4007 T2504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4008 T2504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728
[junit4:junit4]   2> 4008 T2504 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/solr.xml
[junit4:junit4]   2> 4009 T2504 oasc.CoreContainer.<init> New CoreContainer 710580303
[junit4:junit4]   2> 4009 T2504 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/'
[junit4:junit4]   2> 4010 T2504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/'
[junit4:junit4]   2> 4059 T2504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4060 T2504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4060 T2504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4061 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4061 T2504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4062 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4062 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4062 T2504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4063 T2504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4063 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4084 T2504 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4101 T2504 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:14773/solr
[junit4:junit4]   2> 4102 T2504 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4102 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d677e60
[junit4:junit4]   2> 4103 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4104 T2543 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4104 T2543 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 4105 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:44036
[junit4:junit4]   2> 4105 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:44036
[junit4:junit4]   2> 4107 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250005 with negotiated timeout 20000 for client /140.211.11.196:44036
[junit4:junit4]   2> 4107 T2543 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250005, negotiated timeout = 20000
[junit4:junit4]   2> 4107 T2544 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d677e60 name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4107 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4109 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250005
[junit4:junit4]   2> 4123 T2544 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4123 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:44036 which had sessionid 0x13d741dc9250005
[junit4:junit4]   2> 4123 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250005 closed
[junit4:junit4]   2> 4124 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4135 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@708b8a04
[junit4:junit4]   2> 4136 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4136 T2545 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4136 T2545 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 4137 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52960
[junit4:junit4]   2> 4137 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52960
[junit4:junit4]   2> 4138 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250006 with negotiated timeout 20000 for client /140.211.11.196:52960
[junit4:junit4]   2> 4138 T2545 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250006, negotiated timeout = 20000
[junit4:junit4]   2> 4138 T2546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@708b8a04 name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4139 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4140 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4141 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4150 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 5153 T2504 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50387_v%2Ff
[junit4:junit4]   2> 5154 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50387_v%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50387_v%2Ff
[junit4:junit4]   2> 5155 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50387_v%2Ff
[junit4:junit4]   2> 5158 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5159 T2533 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5159 T2546 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5160 T2526 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5173 T2547 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/collection1
[junit4:junit4]   2> 5174 T2547 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 5174 T2547 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 5174 T2547 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 5176 T2547 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/collection1/'
[junit4:junit4]   2> 5177 T2547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/collection1/lib/README' to classloader
[junit4:junit4]   2> 5177 T2547 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 5222 T2547 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 5259 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5260 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:41196_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:41196_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:41196/v/f"}
[junit4:junit4]   2> 5272 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5272 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5272 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5277 T2547 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 5278 T2547 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 5284 T2547 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5880 T2547 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5891 T2547 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5895 T2547 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5908 T2547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5912 T2547 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5917 T2547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5918 T2547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5918 T2547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5919 T2547 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5920 T2547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 5920 T2547 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 5920 T2547 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5920 T2547 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363452745728/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/
[junit4:junit4]   2> 5921 T2547 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ebafdff
[junit4:junit4]   2> 5921 T2547 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5922 T2547 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1 forceNew: false
[junit4:junit4]   2> 5922 T2547 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index/
[junit4:junit4]   2> 5923 T2547 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5924 T2547 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index forceNew: false
[junit4:junit4]   2> 5929 T2547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5930 T2547 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5932 T2547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5933 T2547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5933 T2547 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5934 T2547 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5934 T2547 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5934 T2547 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5935 T2547 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5935 T2547 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5936 T2547 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5942 T2547 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5950 T2547 oass.SolrIndexSearcher.<init> Opening Searcher@7b1d8f08 main
[junit4:junit4]   2> 5951 T2547 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5951 T2547 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5955 T2548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b1d8f08 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5956 T2547 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5957 T2547 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6777 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 6778 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:50387_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50387/v/f"}
[junit4:junit4]   2> 6778 T2527 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6778 T2527 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6798 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6798 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6798 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6959 T2547 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6959 T2547 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50387/v/f collection:collection1 shard:shard1
[junit4:junit4]   2> 6960 T2547 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6977 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6978 T2547 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6978 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6988 T2547 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6988 T2547 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6988 T2547 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 6988 T2547 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6989 T2547 oasc.SyncStrategy.syncToMe http://127.0.0.1:50387/v/f/collection1/ has no replicas
[junit4:junit4]   2> 6989 T2547 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 6989 T2547 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6992 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8309 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8329 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8329 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8329 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8379 T2547 oasc.ZkController.register We are http://127.0.0.1:50387/v/f/collection1/ and leader is http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 8379 T2547 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50387/v/f
[junit4:junit4]   2> 8379 T2547 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 8379 T2547 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8379 T2547 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8381 T2547 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8382 T2504 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 8382 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 8383 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 8578 T2504 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 8581 T2504 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16199
[junit4:junit4]   2> 8582 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 8582 T2504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 8583 T2504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308
[junit4:junit4]   2> 8583 T2504 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/solr.xml
[junit4:junit4]   2> 8583 T2504 oasc.CoreContainer.<init> New CoreContainer 861928702
[junit4:junit4]   2> 8584 T2504 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/'
[junit4:junit4]   2> 8585 T2504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/'
[junit4:junit4]   2> 8633 T2504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 8633 T2504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 8633 T2504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 8634 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 8634 T2504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 8635 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 8635 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 8636 T2504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 8636 T2504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 8636 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 8655 T2504 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 8672 T2504 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:14773/solr
[junit4:junit4]   2> 8673 T2504 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 8673 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7fc4b2e0
[junit4:junit4]   2> 8674 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8675 T2559 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8675 T2559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 8676 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52858
[junit4:junit4]   2> 8676 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52858
[junit4:junit4]   2> 8678 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250007 with negotiated timeout 20000 for client /140.211.11.196:52858
[junit4:junit4]   2> 8678 T2559 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250007, negotiated timeout = 20000
[junit4:junit4]   2> 8678 T2560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fc4b2e0 name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8679 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8680 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250007
[junit4:junit4]   2> 8692 T2560 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8692 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52858 which had sessionid 0x13d741dc9250007
[junit4:junit4]   2> 8692 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250007 closed
[junit4:junit4]   2> 8693 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 8702 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@b9658ca
[junit4:junit4]   2> 8703 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8703 T2561 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8704 T2561 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 8704 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:61944
[junit4:junit4]   2> 8704 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:61944
[junit4:junit4]   2> 8705 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250008 with negotiated timeout 20000 for client /140.211.11.196:61944
[junit4:junit4]   2> 8705 T2561 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250008, negotiated timeout = 20000
[junit4:junit4]   2> 8706 T2562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9658ca name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8706 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8707 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8708 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8717 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 9719 T2504 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16199_v%2Ff
[junit4:junit4]   2> 9720 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc9250008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:16199_v%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:16199_v%2Ff
[junit4:junit4]   2> 9722 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16199_v%2Ff
[junit4:junit4]   2> 9724 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9725 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9725 T2546 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9725 T2562 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9726 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9727 T2526 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9727 T2533 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 9733 T2563 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/collection1
[junit4:junit4]   2> 9733 T2563 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 9734 T2563 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 9734 T2563 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 9735 T2563 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/collection1/'
[junit4:junit4]   2> 9736 T2563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 9737 T2563 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/collection1/lib/README' to classloader
[junit4:junit4]   2> 9782 T2563 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 9835 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 9836 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:50387_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:50387_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:50387/v/f"}
[junit4:junit4]   2> 9842 T2563 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 9847 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9847 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9847 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9847 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9847 T2563 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 9854 T2563 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10440 T2563 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10451 T2563 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10455 T2563 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10469 T2563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10475 T2563 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10481 T2563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10482 T2563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10485 T2563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10485 T2563 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10486 T2563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 10486 T2563 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 10486 T2563 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10487 T2563 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363452750308/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/
[junit4:junit4]   2> 10487 T2563 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ebafdff
[junit4:junit4]   2> 10487 T2563 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10488 T2563 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2 forceNew: false
[junit4:junit4]   2> 10489 T2563 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index/
[junit4:junit4]   2> 10489 T2563 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10490 T2563 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index forceNew: false
[junit4:junit4]   2> 10495 T2563 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70cb0d16; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10496 T2563 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10498 T2563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10498 T2563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10499 T2563 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10500 T2563 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10500 T2563 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10500 T2563 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10501 T2563 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10501 T2563 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10501 T2563 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10508 T2563 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10515 T2563 oass.SolrIndexSearcher.<init> Opening Searcher@1ecc95bc main
[junit4:junit4]   2> 10516 T2563 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10516 T2563 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10519 T2564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ecc95bc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 10521 T2563 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 10521 T2563 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11351 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11352 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:16199_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:16199/v/f"}
[junit4:junit4]   2> 11352 T2527 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 11352 T2527 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11394 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11394 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11394 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11394 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11524 T2563 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 11524 T2563 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16199/v/f collection:collection1 shard:shard1
[junit4:junit4]   2> 11527 T2563 oasc.ZkController.register We are http://127.0.0.1:16199/v/f/collection1/ and leader is http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 11527 T2563 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16199/v/f
[junit4:junit4]   2> 11527 T2563 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 11527 T2563 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C353 name=collection1 org.apache.solr.core.SolrCore@1217040e url=http://127.0.0.1:16199/v/f/collection1 node=127.0.0.1:16199_v%2Ff C353_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:16199_v%2Ff, base_url=http://127.0.0.1:16199/v/f}
[junit4:junit4]   2> 11528 T2565 C353 P16199 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 11529 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 11529 T2563 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 11529 T2565 C353 P16199 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 11529 T2565 C353 P16199 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11530 T2504 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 11530 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11531 T2565 C353 P16199 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11531 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11733 T2504 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11736 T2504 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40057
[junit4:junit4]   2> 11736 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11737 T2504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11737 T2504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460
[junit4:junit4]   2> 11738 T2504 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/solr.xml
[junit4:junit4]   2> 11738 T2504 oasc.CoreContainer.<init> New CoreContainer 1376089625
[junit4:junit4]   2> 11739 T2504 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/'
[junit4:junit4]   2> 11739 T2504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/'
[junit4:junit4]   2> 11789 T2504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 11790 T2504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11790 T2504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11791 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11791 T2504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11791 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11792 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11792 T2504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11793 T2504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11793 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11813 T2504 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11831 T2504 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:14773/solr
[junit4:junit4]   2> 11832 T2504 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11833 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4795cd32
[junit4:junit4]   2> 11834 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11835 T2576 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11836 T2576 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 11836 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30424
[junit4:junit4]   2> 11836 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30424
[junit4:junit4]   2> 11845 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc9250009 with negotiated timeout 20000 for client /140.211.11.196:30424
[junit4:junit4]   2> 11845 T2576 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc9250009, negotiated timeout = 20000
[junit4:junit4]   2> 11846 T2577 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4795cd32 name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11846 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11847 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc9250009
[junit4:junit4]   2> 11848 T2577 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11848 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:30424 which had sessionid 0x13d741dc9250009
[junit4:junit4]   2> 11848 T2504 oaz.ZooKeeper.close Session: 0x13d741dc9250009 closed
[junit4:junit4]   2> 11849 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 11860 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@345a7beb
[junit4:junit4]   2> 11861 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11861 T2578 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11862 T2578 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 11862 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26169
[junit4:junit4]   2> 11862 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26169
[junit4:junit4]   2> 11863 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc925000a with negotiated timeout 20000 for client /140.211.11.196:26169
[junit4:junit4]   2> 11863 T2578 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc925000a, negotiated timeout = 20000
[junit4:junit4]   2> 11863 T2579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@345a7beb name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11864 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11865 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11866 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11868 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 12871 T2504 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40057_v%2Ff
[junit4:junit4]   2> 12872 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000a type:delete cxid:0xb zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40057_v%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40057_v%2Ff
[junit4:junit4]   2> 12873 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40057_v%2Ff
[junit4:junit4]   2> 12875 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12875 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12876 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12877 T2546 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12877 T2579 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12877 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12878 T2562 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12878 T2533 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12878 T2526 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 12894 T2580 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/collection1
[junit4:junit4]   2> 12894 T2580 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12895 T2580 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12895 T2580 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12896 T2580 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/collection1/'
[junit4:junit4]   2> 12897 T2580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/collection1/lib/README' to classloader
[junit4:junit4]   2> 12898 T2580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12898 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 12899 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:16199_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:16199_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:16199/v/f"}
[junit4:junit4]   2> 12910 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12910 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12910 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12910 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12910 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12944 T2580 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 12999 T2580 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13000 T2580 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13006 T2580 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13552 T2536 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:16199_v%252Ff_collection1&state=recovering&nodeName=127.0.0.1:16199_v%252Ff&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4]   2> 13597 T2580 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13608 T2580 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13612 T2580 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13624 T2580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13629 T2580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13633 T2580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13634 T2580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13634 T2580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13635 T2580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13635 T2580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 13636 T2580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 13636 T2580 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13636 T2580 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363452753460/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/
[junit4:junit4]   2> 13636 T2580 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ebafdff
[junit4:junit4]   2> 13637 T2580 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13638 T2580 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3 forceNew: false
[junit4:junit4]   2> 13638 T2580 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index/
[junit4:junit4]   2> 13639 T2580 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13639 T2580 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index forceNew: false
[junit4:junit4]   2> 13675 T2580 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc58f7c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13675 T2580 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13678 T2580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13678 T2580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13678 T2580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13679 T2580 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13680 T2580 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13680 T2580 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13680 T2580 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13681 T2580 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13681 T2580 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13688 T2580 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13695 T2580 oass.SolrIndexSearcher.<init> Opening Searcher@73d6eae4 main
[junit4:junit4]   2> 13696 T2580 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13696 T2580 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13700 T2581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73d6eae4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13702 T2580 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13702 T2580 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14415 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 14416 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:40057_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:40057/v/f"}
[junit4:junit4]   2> 14416 T2527 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 14416 T2527 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 14421 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14421 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14421 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14421 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14421 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 14704 T2580 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 14704 T2580 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40057/v/f collection:collection1 shard:shard1
[junit4:junit4]   2> 14707 T2580 oasc.ZkController.register We are http://127.0.0.1:40057/v/f/collection1/ and leader is http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 14707 T2580 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40057/v/f
[junit4:junit4]   2> 14707 T2580 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 14707 T2580 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C354 name=collection1 org.apache.solr.core.SolrCore@357bcfe5 url=http://127.0.0.1:40057/v/f/collection1 node=127.0.0.1:40057_v%2Ff C354_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40057_v%2Ff, base_url=http://127.0.0.1:40057/v/f}
[junit4:junit4]   2> 14708 T2582 C354 P40057 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 14709 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 14709 T2580 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 14709 T2582 C354 P40057 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 14709 T2582 C354 P40057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14710 T2504 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 14711 T2582 C354 P40057 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14711 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 14711 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14911 T2504 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 14914 T2504 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48068
[junit4:junit4]   2> 14914 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 14915 T2504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14915 T2504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637
[junit4:junit4]   2> 14915 T2504 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/solr.xml
[junit4:junit4]   2> 14916 T2504 oasc.CoreContainer.<init> New CoreContainer 2014262827
[junit4:junit4]   2> 14917 T2504 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/'
[junit4:junit4]   2> 14917 T2504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/'
[junit4:junit4]   2> 14966 T2504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 14967 T2504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 14967 T2504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 14968 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 14968 T2504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 14969 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 14969 T2504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 14970 T2504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 14970 T2504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 14970 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 14997 T2504 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 15015 T2504 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:14773/solr
[junit4:junit4]   2> 15016 T2504 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 15016 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@b0f2fbb
[junit4:junit4]   2> 15018 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15018 T2593 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15019 T2593 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 15019 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16412
[junit4:junit4]   2> 15020 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16412
[junit4:junit4]   2> 15021 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc925000b with negotiated timeout 20000 for client /140.211.11.196:16412
[junit4:junit4]   2> 15021 T2593 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc925000b, negotiated timeout = 20000
[junit4:junit4]   2> 15022 T2594 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0f2fbb name:ZooKeeperConnection Watcher:127.0.0.1:14773 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15022 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15023 T2509 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d741dc925000b
[junit4:junit4]   2> 15024 T2594 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15024 T2506 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16412 which had sessionid 0x13d741dc925000b
[junit4:junit4]   2> 15024 T2504 oaz.ZooKeeper.close Session: 0x13d741dc925000b closed
[junit4:junit4]   2> 15025 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 15035 T2504 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:14773/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5082fd63
[junit4:junit4]   2> 15036 T2504 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15036 T2595 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:14773. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 15037 T2595 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:14773, initiating session
[junit4:junit4]   2> 15037 T2506 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64665
[junit4:junit4]   2> 15037 T2506 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64665
[junit4:junit4]   2> 15039 T2508 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d741dc925000c with negotiated timeout 20000 for client /140.211.11.196:64665
[junit4:junit4]   2> 15039 T2595 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:14773, sessionid = 0x13d741dc925000c, negotiated timeout = 20000
[junit4:junit4]   2> 15039 T2596 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5082fd63 name:ZooKeeperConnection Watcher:127.0.0.1:14773/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15039 T2504 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15040 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15041 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15050 T2504 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2>  C353_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:16199_v%2Ff, base_url=http://127.0.0.1:16199/v/f}
[junit4:junit4]   2> 15553 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50387/v/f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15553 T2565 C353 P16199 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:16199/v/f START replicas=[http://127.0.0.1:50387/v/f/collection1/] nUpdates=100
[junit4:junit4]   2> 15554 T2565 C353 P16199 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15554 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15554 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15555 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15555 T2565 C353 P16199 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15555 T2565 C353 P16199 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50387/v/f/collection1/. core=collection1
[junit4:junit4]   2> 15555 T2565 C353 P16199 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C355 name=collection1 org.apache.solr.core.SolrCore@77cdfbff url=http://127.0.0.1:50387/v/f/collection1 node=127.0.0.1:50387_v%2Ff C355_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50387_v%2Ff, base_url=http://127.0.0.1:50387/v/f, leader=true}
[junit4:junit4]   2> 15561 T2538 C355 P50387 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 15565 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 15570 T2539 C355 P50387 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15570 T2539 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15592 T2539 C355 P50387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15592 T2539 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15594 T2539 C355 P50387 oass.SolrIndexSearcher.<init> Opening Searcher@6e054828 realtime
[junit4:junit4]   2> 15594 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15594 T2539 C355 P50387 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4]   2> 15595 T2565 C353 P16199 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15595 T2565 C353 P16199 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15597 T2540 C355 P50387 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15597 T2540 C355 P50387 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 15598 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 15598 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15598 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15600 T2540 C355 P50387 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4]   2> 15601 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15602 T2565 C353 P16199 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index.20130316135237513 forceNew: false
[junit4:junit4]   2> 15603 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index.20130316135237513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f3f6a35; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 15606 T2540 C355 P50387 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4]   2> 15607 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15610 T2565 C353 P16199 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15610 T2565 C353 P16199 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15614 T2565 C353 P16199 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70cb0d16; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70cb0d16; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15614 T2565 C353 P16199 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15614 T2565 C353 P16199 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15615 T2565 C353 P16199 oass.SolrIndexSearcher.<init> Opening Searcher@412fd776 main
[junit4:junit4]   2> 15616 T2564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@412fd776 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 15616 T2565 C353 P16199 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index.20130316135237513 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f3f6a35; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 15618 T2565 C353 P16199 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15618 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15618 T2565 C353 P16199 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15618 T2565 C353 P16199 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15620 T2565 C353 P16199 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15938 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 15939 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:40057_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:40057_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:40057/v/f"}
[junit4:junit4]   2> 15942 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:16199_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:16199_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:16199/v/f"}
[junit4:junit4]   2> 15957 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15958 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15958 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15958 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15957 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15957 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16054 T2504 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48068_v%2Ff
[junit4:junit4]   2> 16055 T2509 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d741dc925000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:48068_v%2Ff Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:48068_v%2Ff
[junit4:junit4]   2> 16056 T2504 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48068_v%2Ff
[junit4:junit4]   2> 16059 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16059 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16059 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16060 T2596 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16059 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16060 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16059 T2546 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16060 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 16061 T2562 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16068 T2579 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16068 T2533 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16068 T2526 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 16075 T2599 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/collection1
[junit4:junit4]   2> 16076 T2599 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16076 T2599 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16076 T2599 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16078 T2599 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/collection1/'
[junit4:junit4]   2> 16079 T2599 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16079 T2599 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/collection1/lib/README' to classloader
[junit4:junit4]   2> 16143 T2599 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 16197 T2599 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16198 T2599 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16204 T2599 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 16729 T2537 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:40057_v%252Ff_collection1&state=recovering&nodeName=127.0.0.1:40057_v%252Ff&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4]   2> 16782 T2599 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 16793 T2599 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 16797 T2599 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 16810 T2599 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 16814 T2599 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 16818 T2599 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 16819 T2599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 16820 T2599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 16820 T2599 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 16821 T2599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 16821 T2599 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 16821 T2599 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 16822 T2599 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363452756637/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/
[junit4:junit4]   2> 16822 T2599 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ebafdff
[junit4:junit4]   2> 16822 T2599 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 16823 T2599 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4 forceNew: false
[junit4:junit4]   2> 16824 T2599 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index/
[junit4:junit4]   2> 16824 T2599 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 16825 T2599 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index forceNew: false
[junit4:junit4]   2> 16835 T2599 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d28b6be; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 16835 T2599 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 16838 T2599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 16838 T2599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 16839 T2599 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 16839 T2599 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 16840 T2599 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 16840 T2599 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 16840 T2599 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 16841 T2599 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 16841 T2599 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 16848 T2599 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 16855 T2599 oass.SolrIndexSearcher.<init> Opening Searcher@3f0a7cd main
[junit4:junit4]   2> 16856 T2599 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 16856 T2599 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 16860 T2600 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f0a7cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 16862 T2599 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 16862 T2599 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17465 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17466 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48068_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48068/v/f"}
[junit4:junit4]   2> 17466 T2527 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 17467 T2527 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17480 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17480 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17480 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17480 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17480 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17480 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17865 T2599 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 17865 T2599 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48068/v/f collection:collection1 shard:shard1
[junit4:junit4]   2> 17879 T2599 oasc.ZkController.register We are http://127.0.0.1:48068/v/f/collection1/ and leader is http://127.0.0.1:50387/v/f/collection1/
[junit4:junit4]   2> 17879 T2599 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48068/v/f
[junit4:junit4]   2> 17879 T2599 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 17879 T2599 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C356 name=collection1 org.apache.solr.core.SolrCore@496727ba url=http://127.0.0.1:48068/v/f/collection1 node=127.0.0.1:48068_v%2Ff C356_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48068_v%2Ff, base_url=http://127.0.0.1:48068/v/f}
[junit4:junit4]   2> 17880 T2601 C356 P48068 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 17880 T2599 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17881 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 17881 T2601 C356 P48068 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 17881 T2601 C356 P48068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17882 T2504 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1
[junit4:junit4]   2> 17882 T2504 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 17883 T2601 C356 P48068 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17883 T2504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17903 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 17905 T2504 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   2> 17905 T2504 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   2> 17906 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C354_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40057_v%2Ff, base_url=http://127.0.0.1:40057/v/f}
[junit4:junit4]   2> 18730 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50387/v/f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 18730 T2582 C354 P40057 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40057/v/f START replicas=[http://127.0.0.1:50387/v/f/collection1/] nUpdates=100
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 18731 T2582 C354 P40057 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50387/v/f/collection1/. core=collection1
[junit4:junit4]   2> 18732 T2582 C354 P40057 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18733 T2538 C355 P50387 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 18742 T2542 C355 P50387 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 18746 T2542 C355 P50387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18747 T2542 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18748 T2542 C355 P50387 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 18748 T2542 C355 P50387 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4]   2> 18749 T2582 C354 P40057 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 18749 T2582 C354 P40057 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 18751 T2540 C355 P50387 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 18751 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4]   2> 18752 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 18752 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 18755 T2540 C355 P50387 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4]   2> 18755 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 18756 T2582 C354 P40057 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index.20130316135240667 forceNew: false
[junit4:junit4]   2> 18757 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index.20130316135240667 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23183621; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 18760 T2540 C355 P50387 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4]   2> 18761 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 18763 T2582 C354 P40057 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 18763 T2582 C354 P40057 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 18767 T2582 C354 P40057 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc58f7c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc58f7c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 18767 T2582 C354 P40057 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 18768 T2582 C354 P40057 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 18768 T2582 C354 P40057 oass.SolrIndexSearcher.<init> Opening Searcher@33f00983 main
[junit4:junit4]   2> 18769 T2581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33f00983 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 18770 T2582 C354 P40057 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index.20130316135240667 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23183621; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 18771 T2582 C354 P40057 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 18771 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 18771 T2582 C354 P40057 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 18772 T2582 C354 P40057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18773 T2582 C354 P40057 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 18907 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 18984 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 18985 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:48068_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48068_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48068/v/f"}
[junit4:junit4]   2> 18988 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:40057_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:40057_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:40057/v/f"}
[junit4:junit4]   2> 19000 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19001 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19001 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19001 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19000 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19001 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19906 T2541 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:48068_v%252Ff_collection1&state=recovering&nodeName=127.0.0.1:48068_v%252Ff&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4]   2> 19909 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 20911 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2>  C356_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48068_v%2Ff, base_url=http://127.0.0.1:48068/v/f}
[junit4:junit4]   2> 21907 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50387/v/f/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 21907 T2601 C356 P48068 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48068/v/f START replicas=[http://127.0.0.1:50387/v/f/collection1/] nUpdates=100
[junit4:junit4]   2> 21908 T2601 C356 P48068 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 21908 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 21909 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 21909 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 21909 T2601 C356 P48068 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 21909 T2601 C356 P48068 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50387/v/f/collection1/. core=collection1
[junit4:junit4]   2> 21909 T2601 C356 P48068 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 21910 T2538 C355 P50387 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4]   2> 21913 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 21923 T2536 C355 P50387 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 21941 T2536 C355 P50387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21942 T2536 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21943 T2536 C355 P50387 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 21943 T2536 C355 P50387 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4]   2> 21944 T2601 C356 P48068 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 21944 T2601 C356 P48068 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 21946 T2540 C355 P50387 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 21946 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4]   2> 21947 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 21947 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 21949 T2540 C355 P50387 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4]   2> 21950 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 21951 T2601 C356 P48068 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index.20130316135243862 forceNew: false
[junit4:junit4]   2> 21953 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index.20130316135243862 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54587c98; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4]   2> 21956 T2540 C355 P50387 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4]   2> 21957 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 21959 T2601 C356 P48068 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 21960 T2601 C356 P48068 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 21963 T2601 C356 P48068 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d28b6be; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d28b6be; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 21964 T2601 C356 P48068 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 21964 T2601 C356 P48068 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 21965 T2601 C356 P48068 oass.SolrIndexSearcher.<init> Opening Searcher@2a82f689 main
[junit4:junit4]   2> 21966 T2600 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a82f689 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 21966 T2601 C356 P48068 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index.20130316135243862 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54587c98; maxCacheMB=48.0 maxMergeSizeMB=4.0)
[junit4:junit4]   2> 21968 T2601 C356 P48068 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 21968 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 21968 T2601 C356 P48068 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 21968 T2601 C356 P48068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 21970 T2601 C356 P48068 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 22016 T2527 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22017 T2527 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":"127.0.0.1:48068_v%2Ff_collection1",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:48068_v%2Ff",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:48068/v/f"}
[junit4:junit4]   2> 22030 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22030 T2546 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22030 T2533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22030 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22030 T2526 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22030 T2562 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22915 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22916 T2504 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4]   2> ASYNC  NEW_CORE C357 name=collection1 org.apache.solr.core.SolrCore@2086251b url=http://127.0.0.1:41196/v/f/collection1 node=127.0.0.1:41196_v%2Ff C357_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:41196_v%2Ff, base_url=http://127.0.0.1:41196/v/f, leader=true}
[junit4:junit4]   2> 22925 T2516 C357 P41196 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22930 T2516 C357 P41196 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22931 T2516 C357 P41196 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22935 T2516 C357 P41196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 22935 T2516 C357 P41196 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 22939 T2516 C357 P41196 oass.SolrIndexSearcher.<init> Opening Searcher@74047c30 main
[junit4:junit4]   2> 22939 T2516 C357 P41196 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22940 T2530 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74047c30 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22940 T2516 C357 P41196 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   2> 22950 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22954 T2539 C355 P50387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22954 T2539 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22956 T2539 C355 P50387 oass.SolrIndexSearcher.<init> Opening Searcher@21b4c184 main
[junit4:junit4]   2> 22956 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22957 T2548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21b4c184 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22957 T2539 C355 P50387 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:16199/v/f/collection1/, StdNode: http://127.0.0.1:40057/v/f/collection1/, StdNode: http://127.0.0.1:48068/v/f/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2>  C356_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48068_v%2Ff, base_url=http://127.0.0.1:48068/v/f}
[junit4:junit4]   2> 22970 T2586 C356 P48068 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22976 T2586 C356 P48068 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d28b6be; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d28b6be; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> 22976 T2586 C356 P48068 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4]   2> 22978 T2586 C356 P48068 oass.SolrIndexSearcher.<init> Opening Searcher@6f7cb8b1 main
[junit4:junit4]   2> 22979 T2586 C356 P48068 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22979 T2600 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f7cb8b1 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   2> 22979 T2586 C356 P48068 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4]   2>  C353_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:16199_v%2Ff, base_url=http://127.0.0.1:16199/v/f}
[junit4:junit4]   2> 22983 T2552 C353 P16199 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2>  C354_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40057_v%2Ff, base_url=http://127.0.0.1:40057/v/f}
[junit4:junit4]   2> 22983 T2569 C354 P40057 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 22988 T2569 C354 P40057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc58f7c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc58f7c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> 22988 T2552 C353 P16199 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70cb0d16; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70cb0d16; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 22989 T2569 C354 P40057 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4]   2> 22989 T2552 C353 P16199 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 22991 T2569 C354 P40057 oass.SolrIndexSearcher.<init> Opening Searcher@5ea2e094 main
[junit4:junit4]   2> 22991 T2552 C353 P16199 oass.SolrIndexSearcher.<init> Opening Searcher@565cdb0 main
[junit4:junit4]   2> 22992 T2552 C353 P16199 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22992 T2569 C354 P40057 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 22992 T2581 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1118)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:433)
[junit4:junit4]   2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:421)
[junit4:junit4]   2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:541)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:138)
[junit4:junit4]   2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1763)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4]   2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1640)
[junit4:junit4]   2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4]   2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2>
[junit4:junit4]   2> 22993 T2564 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@565cdb0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 22993 T2581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ea2e094 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   2> 22993 T2552 C353 P16199 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4]   2> 22994 T2569 C354 P40057 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4]   2> 22994 T2539 C355 P50387 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 44
[junit4:junit4]   2> 22995 T2504 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 22998 T2537 C355 P50387 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4]   2> 22999 T2553 C353 P16199 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 23001 T2570 C354 P40057 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 23003 T2587 C356 P48068 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4]   2> 25008 T2516 C357 P41196 oass.SolrIndexSearcher.<init> Opening Searcher@6144eaf8 realtime
[junit4:junit4]   2> 25009 T2516 C357 P41196 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429683848523808768)} 0 3
[junit4:junit4]   2> 25016 T2552 C353 P16199 /update {update.distrib=FROMLEADER&_version_=-1429683848529051648&update.from=http://127.0.0.1:50387/v/f/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429683848529051648)} 0 1
[junit4:junit4]   2> 25016 T2569 C354 P40057 /update {update.distrib=FROMLEADER&_version_=-1429683848529051648&update.from=http://127.0.0.1:50387/v/f/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429683848529051648)} 0 1
[junit4:junit4]   2> 25016 T2586 C356 P48068 /update {update.distrib=FROMLEADER&_version_=-1429683848529051648&update.from=http://127.0.0.1:50387/v/f/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429683848529051648)} 0 2
[junit4:junit4]   2> 25016 T2539 C355 P50387 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429683848529051648)} 0 5
[junit4:junit4]   2> 25021 T2516 C357 P41196 /update {wt=javabin&version=2} {add=[0 (1429683848537440256)]} 0 2
[junit4:junit4]   2> 25028 T2586 C356 P48068 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429683848541634560)]} 0 2
[junit4:junit4]   2> 25028 T2569 C354 P40057 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429683848541634560)]} 0 2
[junit4:junit4]   2> 25028 T2552 C353 P16199 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429683848541634560)]} 0 2
[junit4:junit4]   2> 25029 T2539 C355 P50387 /update {wt=javabin&version=2} {add=[0 (1429683848541634560)]} 0 6
[junit4:junit4]   2> 25031 T2516 C357 P41196 /update {wt=javabin&version=2} {add=[1 (1429683848550023168)]} 0 0
[junit4:junit4]   2> 25038 T2586 C356 P48068 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429683848553168896)]} 0 1
[junit4:junit4]   2> 25038 T2552 C353 P16199 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429683848553168896)]} 0 1
[junit4:junit4]   2> 25038 T2569 C354 P40057 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429683848553168896)]} 0 1
[junit4:junit4]   2> 25039 T2539 C355 P50387 /update {wt=javabin&version=2} {add=[1 (1429683848553168896)]} 0 5
[junit4:junit4]   2> 25041 T2516 C357 P41196 /update {wt=javabin&version=2} {add=[2 (1429683848560508928)]} 0 0
[junit4:junit4]   2> 25047 T2569 C354 P40057 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429683848563654656)]} 0 0
[junit4:junit4]   2> 25048 T2586 C356 P48068 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429683848563654656)]} 0 1
[junit4:junit4]   2> 25048 T2539 C355 P50387 /update {test.distrib.skip.servers=http://127.0.0.1:16199/v/f/collection1/&wt=javabin&version=2} {add=[2 (1429683848563654656)]} 0 4
[junit4:junit4]   2> 25051 T2516 C357 P41196 /update {wt=javabin&version=2} {add=[3 (1429683848570994688)]} 0 0
[junit4:junit4]   2> 25057 T2586 C356 P48068 /update {distrib.from=http://127.0.0.1:50387/v/f/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429683848574140416)]} 0 0
[junit4:junit4]   2> 25058 T2539 C355 P50387 /update {test.distrib.skip.servers=http://127.0.0.1:16199/v/f/collection1/&test.distrib.skip.servers=http://127.0.0.1:40057/v/f/collection1/&wt=javabin&version=2} {add=[3 (1429683848574140416)]} 0 4
[junit4:junit4]   2> 25060 T2516 C357 P41196 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25116 T2516 C357 P41196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36d2fc0e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene40_0.prx, _0.fdt, segments_3, _0_Lucene40_0.tip]
[junit4:junit4]   2> 25117 T2516 C357 P41196 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene40_0.tim, _0.fnm, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene40_0.prx, _0.fdt, segments_3, _0_Lucene40_0.tip]
[junit4:junit4]   2> 25122 T2516 C357 P41196 oass.SolrIndexSearcher.<init> Opening Searcher@21b5a042 main
[junit4:junit4]   2> 25123 T2516 C357 P41196 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 25124 T2530 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21b5a042 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4]   2> 25124 T2516 C357 P41196 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 64
[junit4:junit4]   2> 25127 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25176 T2539 C355 P50387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363452741918/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4331ecb6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene40_0.prx, segments_6, _0.fdt, _0_Lucene40_0.tip]
[junit4:junit4]   2> 25177 T2539 C355 P50387 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene40_0.tim, _0.fnm, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene40_0.prx, segments_6, _0.fdt, _0_Lucene40_0.tip]
[junit4:junit4]   2> 25182 T2539 C355 P50387 oass.SolrIndexSearcher.<init> Opening Searcher@1bfad518 main
[junit4:junit4]   2> 25182 T2539 C355 P50387 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 25183 T2548 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1bfad518 main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4]   2> 25183 T2539 C355 P50387 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:16199/v/f/collection1/, StdNode: http://127.0.0.1:40057/v/f/collection1/, StdNode: http://127.0.0.1:48068/v/f/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   2> 25186 T2569 C354 P40057 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25186 T2586 C356 P48068 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25186 T2552 C353 P16199 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 25283 T2586 C356 P48068 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirect

[...truncated too long message...]

yncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=63E02CC8101653DD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=is_IS -Dtests.timezone=America/Argentina/San_Juan -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  138s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:16199/v/f/collection1 Dead Guy:http://127.0.0.1:50387/v/f/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:48068/v/f/collection1], CloudJettyRunner [url=http://127.0.0.1:40057/v/f/collection1]]
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([63E02CC8101653DD:E206A2D0674933E1]:0)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4]    > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
[junit4:junit4]    > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4]   2> 138204 T2504 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 138208 T2503 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 139160 T2596 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 139160 T2596 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 139160 T2596 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 139160 T2596 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=is_IS, timezone=America/Argentina/San_Juan
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=5,free=203112280,total=444071936
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestCollationField, XmlUpdateRequestHandlerTest, BasicDistributedZk2Test, HighlighterTest, TestStressReorder, TestWordDelimiterFilterFactory, DirectUpdateHandlerTest, DefaultValueUpdateProcessorTest, TestNumberUtils, SortByFunctionTest, RequestHandlersTest, JSONWriterTest, TestStressLucene, UniqFieldsUpdateProcessorFactoryTest, TestAtomicUpdateErrorCases, TestMergePolicyConfig, SolrCmdDistributorTest, TestAnalyzedSuggestions, SolrIndexConfigTest, TestDistributedGrouping, DocValuesMultiTest, NumericFieldsTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, OpenCloseCoreStressTest, TestReload, TestSolrJ, TestUtils, TestFastOutputStream, StatsComponentTest, IndexSchemaRuntimeFieldTest, SuggesterTSTTest, ZkSolrClientTest, LeaderElectionIntegrationTest, TestDynamicFieldCollectionResource, BasicZkTest, XsltUpdateRequestHandlerTest, TestIndexingPerformance, HighlighterConfigTest, TestDefaultSimilarityFactory, HardAutoCommitTest, TestLazyCores, TestMultiCoreConfBootstrap, CurrencyFieldOpenExchangeTest, SolrTestCaseJ4Test, TestDynamicFieldResource, SpellCheckComponentTest, ZkNodePropsTest, TestUpdate, TestDistributedSearch, DocumentAnalysisRequestHandlerTest, DirectSolrSpellCheckerTest, TestElisionMultitermQuery, TestCodecSupport, TestCSVLoader, TestZkChroot, TimeZoneUtilsTest, DistanceFunctionTest, DisMaxRequestHandlerTest, TestComponentsName, TestShardHandlerFactory, TestSolrXMLSerializer, TestLMJelinekMercerSimilarityFactory, DateMathParserTest, IndexReaderFactoryTest, TestRandomFaceting, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 139.24s, 1 test, 1 failure <<< FAILURES!

[...truncated 412 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 27 ignored (8 assumptions)

Total time: 49 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-Tests-4.x-Java6 - Build # 1428 - Still Failing

Apache Jenkins Server-2
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java6/1428/

1 tests failed.
FAILED:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:52591/hf_sx/ii/collection1lastClient and got 5 from http://127.0.0.1:52601/hf_sx/ii/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:52591/hf_sx/ii/collection1lastClient and got 5 from http://127.0.0.1:52601/hf_sx/ii/collection1
        at __randomizedtesting.SeedInfo.seed([A1CCC8D48B3697F1:202A46CCFC69F7CD]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
        at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:233)
        at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:679)




Build Log:
[...truncated 9202 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   2> 0 T2718 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /hf_sx/ii
[junit4:junit4]   2> 5 T2718 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363496304361
[junit4:junit4]   2> 6 T2718 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T2719 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T2719 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 10 T2719 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 10 T2719 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T2719 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 12 T2719 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363496304360/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 108 T2718 oasc.ZkTestServer.run start zk server on port:52482
[junit4:junit4]   2> 108 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@407e10a9
[junit4:junit4]   2> 109 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 110 T2724 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 110 T2724 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 111 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52483
[junit4:junit4]   2> 111 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52483
[junit4:junit4]   2> 112 T2722 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 114 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0000 with negotiated timeout 10000 for client /140.211.11.196:52483
[junit4:junit4]   2> 114 T2724 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0000, negotiated timeout = 10000
[junit4:junit4]   2> 115 T2725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@407e10a9 name:ZooKeeperConnection Watcher:127.0.0.1:52482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 115 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 115 T2718 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 129 T2723 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d76b67eef0000
[junit4:junit4]   2> 130 T2725 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 130 T2720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52483 which had sessionid 0x13d76b67eef0000
[junit4:junit4]   2> 130 T2718 oaz.ZooKeeper.close Session: 0x13d76b67eef0000 closed
[junit4:junit4]   2> 131 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@31751d32
[junit4:junit4]   2> 131 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 132 T2726 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 132 T2726 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 132 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52484
[junit4:junit4]   2> 133 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52484
[junit4:junit4]   2> 134 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0001 with negotiated timeout 10000 for client /140.211.11.196:52484
[junit4:junit4]   2> 134 T2726 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0001, negotiated timeout = 10000
[junit4:junit4]   2> 134 T2727 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31751d32 name:ZooKeeperConnection Watcher:127.0.0.1:52482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 135 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T2718 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 138 T2718 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 147 T2718 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 149 T2718 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 152 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 153 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 164 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 165 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 269 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 270 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 273 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 274 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 282 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 283 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 286 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 287 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 290 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 290 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 293 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 294 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 297 T2718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 297 T2718 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 305 T2723 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d76b67eef0001
[junit4:junit4]   2> 306 T2727 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 306 T2720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52484 which had sessionid 0x13d76b67eef0001
[junit4:junit4]   2> 305 T2718 oaz.ZooKeeper.close Session: 0x13d76b67eef0001 closed
[junit4:junit4]   2> 491 T2718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 497 T2718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52485
[junit4:junit4]   2> 497 T2718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 498 T2718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 498 T2718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661
[junit4:junit4]   2> 499 T2718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/solr.xml
[junit4:junit4]   2> 499 T2718 oasc.CoreContainer.<init> New CoreContainer 390680835
[junit4:junit4]   2> 500 T2718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/'
[junit4:junit4]   2> 500 T2718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/'
[junit4:junit4]   2> 549 T2718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 550 T2718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 550 T2718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 551 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 551 T2718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 552 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 552 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 553 T2718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 553 T2718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 553 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 574 T2718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 593 T2718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52482/solr
[junit4:junit4]   2> 594 T2718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 594 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@73f2153f
[junit4:junit4]   2> 595 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 596 T2737 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 596 T2737 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 597 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52486
[junit4:junit4]   2> 597 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52486
[junit4:junit4]   2> 599 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0002 with negotiated timeout 20000 for client /140.211.11.196:52486
[junit4:junit4]   2> 599 T2737 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0002, negotiated timeout = 20000
[junit4:junit4]   2> 599 T2738 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73f2153f name:ZooKeeperConnection Watcher:127.0.0.1:52482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 599 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 601 T2723 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d76b67eef0002
[junit4:junit4]   2> 602 T2738 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 602 T2720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52486 which had sessionid 0x13d76b67eef0002
[junit4:junit4]   2> 602 T2718 oaz.ZooKeeper.close Session: 0x13d76b67eef0002 closed
[junit4:junit4]   2> 602 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 613 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6dd20f27
[junit4:junit4]   2> 614 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 614 T2739 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 615 T2739 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 615 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52487
[junit4:junit4]   2> 615 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52487
[junit4:junit4]   2> 617 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0003 with negotiated timeout 20000 for client /140.211.11.196:52487
[junit4:junit4]   2> 617 T2739 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0003, negotiated timeout = 20000
[junit4:junit4]   2> 617 T2740 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6dd20f27 name:ZooKeeperConnection Watcher:127.0.0.1:52482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 617 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 619 T2718 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 628 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 630 T2718 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 633 T2718 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 640 T2718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52485_hf_sx%2Fii
[junit4:junit4]   2> 641 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52485_hf_sx%2Fii Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52485_hf_sx%2Fii
[junit4:junit4]   2> 642 T2718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52485_hf_sx%2Fii
[junit4:junit4]   2> 645 T2718 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 660 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 661 T2718 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 664 T2718 oasc.Overseer.start Overseer (id=89358093802995715-127.0.0.1:52485_hf_sx%2Fii-n_0000000000) starting
[junit4:junit4]   2> 665 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 672 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 674 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 676 T2718 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 685 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 686 T2742 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 687 T2718 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 690 T2718 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 696 T2718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 699 T2741 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 703 T2743 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/collection1
[junit4:junit4]   2> 703 T2743 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 704 T2743 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 704 T2743 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 705 T2743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/collection1/'
[junit4:junit4]   2> 706 T2743 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 707 T2743 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/collection1/lib/README' to classloader
[junit4:junit4]   2> 753 T2743 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4]   2> 810 T2743 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 910 T2743 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 916 T2743 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1522 T2743 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1535 T2743 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1539 T2743 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1555 T2743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1559 T2743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1564 T2743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1565 T2743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1565 T2743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1565 T2743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1566 T2743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 1566 T2743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 1567 T2743 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1567 T2743 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363496304661/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data/
[junit4:junit4]   2> 1567 T2743 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6364cbde
[junit4:junit4]   2> 1568 T2743 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1569 T2743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data forceNew: false
[junit4:junit4]   2> 1570 T2743 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data/index/
[junit4:junit4]   2> 1570 T2743 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1571 T2743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data/index forceNew: false
[junit4:junit4]   2> 1578 T2743 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363496304360/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@d023472; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1579 T2743 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1581 T2743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1581 T2743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1582 T2743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1582 T2743 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1583 T2743 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1583 T2743 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1583 T2743 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1584 T2743 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1584 T2743 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1591 T2743 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1599 T2743 oass.SolrIndexSearcher.<init> Opening Searcher@15ac464f main
[junit4:junit4]   2> 1600 T2743 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1600 T2743 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1603 T2744 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15ac464f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1610 T2743 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1610 T2743 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2202 T2741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2203 T2741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "core_node_name":null,
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:52485_hf_sx%2Fii",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:52485/hf_sx/ii"}
[junit4:junit4]   2> 2204 T2741 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2204 T2741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2218 T2740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2613 T2743 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2613 T2743 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52485/hf_sx/ii collection:control_collection shard:shard1
[junit4:junit4]   2> 2614 T2743 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2631 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2632 T2743 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2633 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2635 T2743 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2636 T2743 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2636 T2743 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52485/hf_sx/ii/collection1/
[junit4:junit4]   2> 2636 T2743 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2636 T2743 oasc.SyncStrategy.syncToMe http://127.0.0.1:52485/hf_sx/ii/collection1/ has no replicas
[junit4:junit4]   2> 2637 T2743 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52485/hf_sx/ii/collection1/
[junit4:junit4]   2> 2637 T2743 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2650 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3722 T2741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3786 T2740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3833 T2743 oasc.ZkController.register We are http://127.0.0.1:52485/hf_sx/ii/collection1/ and leader is http://127.0.0.1:52485/hf_sx/ii/collection1/
[junit4:junit4]   2> 3833 T2743 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52485/hf_sx/ii
[junit4:junit4]   2> 3833 T2743 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3833 T2743 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3834 T2743 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3835 T2743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3837 T2718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3838 T2718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3838 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3851 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3852 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ba064fb
[junit4:junit4]   2> 3853 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3853 T2746 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3854 T2746 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 3854 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52488
[junit4:junit4]   2> 3855 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52488
[junit4:junit4]   2> 3856 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0004 with negotiated timeout 10000 for client /140.211.11.196:52488
[junit4:junit4]   2> 3856 T2746 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0004, negotiated timeout = 10000
[junit4:junit4]   2> 3856 T2747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba064fb name:ZooKeeperConnection Watcher:127.0.0.1:52482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3856 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3858 T2718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3860 T2718 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4090 T2718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4093 T2718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52489
[junit4:junit4]   2> 4094 T2718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4095 T2718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4095 T2718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363496308215
[junit4:junit4]   2> 4096 T2718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363496308215/solr.xml
[junit4:junit4]   2> 4096 T2718 oasc.CoreContainer.<init> New CoreContainer 1780957964
[junit4:junit4]   2> 4097 T2718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363496308215/'
[junit4:junit4]   2> 4097 T2718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363496308215/'
[junit4:junit4]   2> 4145 T2718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4146 T2718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4146 T2718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4146 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4147 T2718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4147 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4148 T2718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4148 T2718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4149 T2718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4149 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4167 T2718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4186 T2718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52482/solr
[junit4:junit4]   2> 4186 T2718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4187 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e256933
[junit4:junit4]   2> 4188 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4188 T2757 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4189 T2757 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 4189 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52490
[junit4:junit4]   2> 4190 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52490
[junit4:junit4]   2> 4217 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0005 with negotiated timeout 20000 for client /140.211.11.196:52490
[junit4:junit4]   2> 4217 T2757 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0005, negotiated timeout = 20000
[junit4:junit4]   2> 4217 T2758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e256933 name:ZooKeeperConnection Watcher:127.0.0.1:52482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4217 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4218 T2723 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d76b67eef0005
[junit4:junit4]   2> 4231 T2758 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4231 T2720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52490 which had sessionid 0x13d76b67eef0005
[junit4:junit4]   2> 4231 T2718 oaz.ZooKeeper.close Session: 0x13d76b67eef0005 closed
[junit4:junit4]   2> 4232 T2718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4241 T2718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52482/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@edcb417
[junit4:junit4]   2> 4242 T2718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4242 T2759 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52482. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4242 T2759 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52482, initiating session
[junit4:junit4]   2> 4243 T2720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52491
[junit4:junit4]   2> 4243 T2720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52491
[junit4:junit4]   2> 4244 T2722 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d76b67eef0006 with negotiated timeout 20000 for client /140.211.11.196:52491
[junit4:junit4]   2> 4244 T2759 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52482, sessionid = 0x13d76b67eef0006, negotiated timeout = 20000
[junit4:junit4]   2> 4245 T2760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@edcb417 name:ZooKeeperConnection Watcher:127.0.0.1:52482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4245 T2718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4246 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4248 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4256 T2718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 5259 T2718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52489_hf_sx%2Fii
[junit4:junit4]   2> 5260 T2723 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d76b67eef0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52489_hf_sx%2Fii Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52489_hf_sx%2Fii
[junit4:junit4]   2> 5261 T2718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52489_hf_sx%2Fii
[junit4:junit4]   2> 5265 T2747 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5265 T2760 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5265 T2740 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 5266 T2740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2>