[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.6.0_37) - Build # 1457 - Failure!

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.6.0_37) - Build # 1457 - Failure!

Policeman Jenkins Server
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1457/
Java: 32bit/jdk1.6.0_37 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.RecoveryZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=1798, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=1798, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
        at __randomizedtesting.SeedInfo.seed([194DFF4D8F070D9B]:0)
        at java.lang.Thread.getStackTrace(Thread.java:1479)
        at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
        at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:514)
        at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:958)
        at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:872)
        at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:864)
        at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:33)
        at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:232)
        at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:192)
        at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:373)
        at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:273)
        at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:152)
        at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:407)
        at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:222)
Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@70a4a9 lockFactory=org.apache.lucene.store.SimpleFSLockFactory@1922355)
        at org.junit.Assert.fail(Assert.java:93)
        at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
        at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
        at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
        at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 8005 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4]   2> 2 T1748 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-RecoveryZkTest-1352177828120
[junit4:junit4]   2> 5 T1748 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 10 T1749 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11 T1749 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11 T1749 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 116 T1748 oasc.ZkTestServer.run start zk server on port:56397
[junit4:junit4]   2> 116 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@394fd9
[junit4:junit4]   2> 119 T1754 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 119 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 120 T1754 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 121 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56400
[junit4:junit4]   2> 121 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56400
[junit4:junit4]   2> 121 T1752 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 132 T1754 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220000, negotiated timeout = 10000
[junit4:junit4]   2> 132 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220000 with negotiated timeout 10000 for client /127.0.0.1:56400
[junit4:junit4]   2> 133 T1755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@394fd9 name:ZooKeeperConnection Watcher:127.0.0.1:56397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 134 T1748 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 142 T1753 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ad41441220000
[junit4:junit4]   2> 144 T1755 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 144 T1748 oaz.ZooKeeper.close Session: 0x13ad41441220000 closed
[junit4:junit4]   2> 144 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@834b36
[junit4:junit4]   2> 145 T1750 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ad41441220000, likely client has closed socket
[junit4:junit4]   2> 146 T1750 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56400 which had sessionid 0x13ad41441220000
[junit4:junit4]   2> 147 T1756 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 146 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 147 T1756 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 149 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56403
[junit4:junit4]   2> 149 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56403
[junit4:junit4]   2> 151 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220001 with negotiated timeout 10000 for client /127.0.0.1:56403
[junit4:junit4]   2> 151 T1756 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220001, negotiated timeout = 10000
[junit4:junit4]   2> 151 T1757 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@834b36 name:ZooKeeperConnection Watcher:127.0.0.1:56397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 151 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 151 T1748 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 158 T1748 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 163 T1748 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 181 T1748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 187 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 188 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 196 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 197 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 204 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 205 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 209 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 210 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 214 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 215 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 220 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 220 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 225 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 226 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 231 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 232 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 238 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 240 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 245 T1748 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 246 T1748 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 252 T1753 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ad41441220001
[junit4:junit4]   2> 254 T1748 oaz.ZooKeeper.close Session: 0x13ad41441220001 closed
[junit4:junit4]   2> 255 T1750 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ad41441220001, likely client has closed socket
[junit4:junit4]   2> 255 T1750 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:56403 which had sessionid 0x13ad41441220001
[junit4:junit4]   2> 256 T1757 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 672 T1748 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 682 T1748 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:56404
[junit4:junit4]   2> 683 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 683 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371
[junit4:junit4]   2> 685 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\'
[junit4:junit4]   2> 714 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 715 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 715 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371
[junit4:junit4]   2> 715 T1748 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\solr.xml
[junit4:junit4]   2> 717 T1748 oasc.CoreContainer.<init> New CoreContainer 7503034
[junit4:junit4]   2> 717 T1748 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\'
[junit4:junit4]   2> 717 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\'
[junit4:junit4]   2> 743 T1748 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 765 T1748 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56397/solr
[junit4:junit4]   2> 765 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@17b4c84
[junit4:junit4]   2> 768 T1767 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 768 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 769 T1767 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 769 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56409
[junit4:junit4]   2> 770 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56409
[junit4:junit4]   2> 777 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220002 with negotiated timeout 5000 for client /127.0.0.1:56409
[junit4:junit4]   2> 777 T1767 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220002, negotiated timeout = 5000
[junit4:junit4]   2> 777 T1768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b4c84 name:ZooKeeperConnection Watcher:127.0.0.1:56397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 777 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 780 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 782 T1748 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 787 T1748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56404_solr
[junit4:junit4]   2> 787 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:delete cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56404_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56404_solr
[junit4:junit4]   2> 789 T1748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56404_solr
[junit4:junit4]   2> 793 T1748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 793 T1748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 794 T1748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 794 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 796 T1748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 796 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 797 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 798 T1748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 798 T1748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 800 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 807 T1748 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 816 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:delete cxid:0x15 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 818 T1748 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 822 T1748 oasc.Overseer.start Overseer (id=88616326144327682-127.0.0.1:56404_solr-n_0000000000) starting
[junit4:junit4]   2> 822 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 824 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 826 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 827 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 829 T1770 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 831 T1748 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 836 T1748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 838 T1769 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 847 T1748 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\collection1
[junit4:junit4]   2> 847 T1748 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 848 T1748 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 848 T1748 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 851 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\collection1\'
[junit4:junit4]   2> 853 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 854 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371/collection1/lib/README' to classloader
[junit4:junit4]   2> 923 T1748 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1023 T1748 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1024 T1748 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1031 T1748 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1905 T1748 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1924 T1748 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1932 T1748 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1954 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1960 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1968 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1971 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1979 T1748 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-controljetty-1352177828371\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/control/data\
[junit4:junit4]   2> 1980 T1748 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13a0212
[junit4:junit4]   2> 1980 T1748 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1981 T1748 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eacf75 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@da18a4) assuming 'simple'
[junit4:junit4]   2> 1982 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data forceNew:false
[junit4:junit4]   2> 1983 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data
[junit4:junit4]   2> 1984 T1748 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/control/data\index/
[junit4:junit4]   2> 1986 T1748 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1987 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data\index forceNew:false
[junit4:junit4]   2> 1992 T1748 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c667e3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f69182),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1993 T1748 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1993 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data\index
[junit4:junit4]   2> 1993 T1748 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1996 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1996 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1997 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1997 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1997 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1997 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1997 T1748 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1997 T1748 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1997 T1748 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1998 T1748 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1999 T1748 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1999 T1748 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2001 T1748 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 2001 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 2001 T1748 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 2002 T1748 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2003 T1748 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2004 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2004 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2005 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2006 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2006 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2007 T1748 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 2009 T1748 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 2011 T1748 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 2018 T1748 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2022 T1748 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 2024 T1748 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 2029 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data
[junit4:junit4]   2> 2030 T1748 oass.SolrIndexSearcher.<init> Opening Searcher@171d407 main
[junit4:junit4]   2> 2033 T1748 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2034 T1748 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2035 T1748 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 2052 T1748 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 2135 T1771 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@171d407 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2140 T1748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2141 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2146 T1748 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2147 T1748 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:56404/solr shardId:control_shard
[junit4:junit4]   2> 2150 T1748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/control_shard/election
[junit4:junit4]   2> 2166 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:delete cxid:0x65 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2169 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2170 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x66 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2488 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 2490 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":null,
[junit4:junit4]   2>  "shard":"control_shard",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56404_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56404/solr"}
[junit4:junit4]   2> 2491 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x6d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2512 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 2721 T1748 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2722 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2722 T1748 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56404/solr/collection1/
[junit4:junit4]   2> 2723 T1748 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2723 T1748 oasc.SyncStrategy.syncToMe http://127.0.0.1:56404/solr/collection1/ has no replicas
[junit4:junit4]   2> 2724 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56404/solr/collection1/
[junit4:junit4]   2> 2724 T1748 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/control_shard
[junit4:junit4]   2> 2740 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220002 type:create cxid:0x8c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3073 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3081 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3135 T1748 oasc.ZkController.register We are http://127.0.0.1:56404/solr/collection1/ and leader is http://127.0.0.1:56404/solr/collection1/
[junit4:junit4]   2> 3136 T1748 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56404/solr
[junit4:junit4]   2> 3137 T1748 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3138 T1748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3144 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3146 T1748 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 3147 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3148 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3168 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3179 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ed3cc7
[junit4:junit4]   2> 3182 T1772 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 3182 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3184 T1772 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 3184 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56412
[junit4:junit4]   2> 3185 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56412
[junit4:junit4]   2> 3190 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220003 with negotiated timeout 10000 for client /127.0.0.1:56412
[junit4:junit4]   2> 3190 T1772 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220003, negotiated timeout = 10000
[junit4:junit4]   2> 3191 T1773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ed3cc7 name:ZooKeeperConnection Watcher:127.0.0.1:56397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3191 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3193 T1748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3197 T1748 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3592 T1748 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 3595 T1748 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:56413
[junit4:junit4]   2> 3596 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3597 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313
[junit4:junit4]   2> 3597 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\'
[junit4:junit4]   2> 3610 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 3610 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":null,
[junit4:junit4]   2>  "shard":"control_shard",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"control_collection",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56404_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56404/solr"}
[junit4:junit4]   2> 3623 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3624 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3637 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3637 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3638 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313
[junit4:junit4]   2> 3638 T1748 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\solr.xml
[junit4:junit4]   2> 3639 T1748 oasc.CoreContainer.<init> New CoreContainer 19974805
[junit4:junit4]   2> 3640 T1748 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\'
[junit4:junit4]   2> 3640 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\'
[junit4:junit4]   2> 3669 T1748 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3691 T1748 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56397/solr
[junit4:junit4]   2> 3692 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ae422e
[junit4:junit4]   2> 3693 T1783 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 3693 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3696 T1783 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 3696 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56418
[junit4:junit4]   2> 3696 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56418
[junit4:junit4]   2> 3698 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220004 with negotiated timeout 5000 for client /127.0.0.1:56418
[junit4:junit4]   2> 3698 T1783 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220004, negotiated timeout = 5000
[junit4:junit4]   2> 3698 T1784 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ae422e name:ZooKeeperConnection Watcher:127.0.0.1:56397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3699 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3700 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3701 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3703 T1748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56413_solr
[junit4:junit4]   2> 3704 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56413_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56413_solr
[junit4:junit4]   2> 3705 T1748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56413_solr
[junit4:junit4]   2> 3708 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3708 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3709 T1748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3709 T1748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3710 T1748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3710 T1773 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 3710 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3710 T1768 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 3711 T1748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3711 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3711 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3712 T1748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3712 T1748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3713 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 3723 T1748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 3731 T1748 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\collection1
[junit4:junit4]   2> 3732 T1748 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3733 T1748 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3733 T1748 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3736 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\collection1\'
[junit4:junit4]   2> 3738 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3739 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313/collection1/lib/README' to classloader
[junit4:junit4]   2> 3794 T1748 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3873 T1748 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3875 T1748 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3886 T1748 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4686 T1748 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4699 T1748 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4704 T1748 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4724 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4728 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4735 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4737 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4739 T1748 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty1-1352177831313\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/jetty1\
[junit4:junit4]   2> 4740 T1748 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13a0212
[junit4:junit4]   2> 4741 T1748 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 4742 T1748 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c101 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b4e9d) assuming 'simple'
[junit4:junit4]   2> 4742 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1 forceNew:false
[junit4:junit4]   2> 4743 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1
[junit4:junit4]   2> 4743 T1748 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/jetty1\index/
[junit4:junit4]   2> 4745 T1748 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4746 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1\index forceNew:false
[junit4:junit4]   2> 4751 T1748 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17b8f60 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ca3bd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4752 T1748 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4752 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1\index
[junit4:junit4]   2> 4753 T1748 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4755 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4756 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4757 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4757 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4759 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4759 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4760 T1748 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4762 T1748 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4764 T1748 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4765 T1748 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4766 T1748 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4767 T1748 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4769 T1748 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4770 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4771 T1748 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4773 T1748 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4774 T1748 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4775 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4780 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4781 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4782 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4783 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4784 T1748 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4785 T1748 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4786 T1748 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4796 T1748 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4801 T1748 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4803 T1748 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4807 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1
[junit4:junit4]   2> 4808 T1748 oass.SolrIndexSearcher.<init> Opening Searcher@18366d main
[junit4:junit4]   2> 4811 T1748 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4812 T1748 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4812 T1748 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4829 T1748 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4917 T1748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4919 T1785 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18366d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5110 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5111 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56413_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56413/solr"}
[junit4:junit4]   2> 5111 T1769 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 5119 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5119 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5121 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5418 T1748 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5418 T1748 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:56413/solr shardId:shard1
[junit4:junit4]   2> 5419 T1748 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 5435 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:delete cxid:0x43 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 5442 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5443 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:create cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5448 T1748 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5449 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5449 T1748 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56413/solr/collection1/
[junit4:junit4]   2> 5450 T1748 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5450 T1748 oasc.SyncStrategy.syncToMe http://127.0.0.1:56413/solr/collection1/ has no replicas
[junit4:junit4]   2> 5451 T1748 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56413/solr/collection1/
[junit4:junit4]   2> 5451 T1748 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 5458 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220004 type:create cxid:0x4e zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5619 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5634 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5634 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5634 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 5663 T1748 oasc.ZkController.register We are http://127.0.0.1:56413/solr/collection1/ and leader is http://127.0.0.1:56413/solr/collection1/
[junit4:junit4]   2> 5664 T1748 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56413/solr
[junit4:junit4]   2> 5664 T1748 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 5665 T1748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5668 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 5670 T1748 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 5670 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5671 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6086 T1748 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 6089 T1748 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:56419
[junit4:junit4]   2> 6091 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6091 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795
[junit4:junit4]   2> 6092 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\'
[junit4:junit4]   2> 6135 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 6136 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"active",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56413_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56413/solr"}
[junit4:junit4]   2> 6146 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6147 T1748 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6147 T1748 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795
[junit4:junit4]   2> 6147 T1748 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\solr.xml
[junit4:junit4]   2> 6148 T1748 oasc.CoreContainer.<init> New CoreContainer 10394054
[junit4:junit4]   2> 6149 T1748 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\'
[junit4:junit4]   2> 6149 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\'
[junit4:junit4]   2> 6154 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 6155 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 6155 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 6177 T1748 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6196 T1748 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56397/solr
[junit4:junit4]   2> 6196 T1748 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56397/solr sessionTimeout=5000 watcher=org.apache.solr.common.cloud.ConnectionManager@8886d4
[junit4:junit4]   2> 6198 T1748 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6198 T1795 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:56397
[junit4:junit4]   2> 6200 T1795 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:56397, initiating session
[junit4:junit4]   2> 6200 T1750 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:56424
[junit4:junit4]   2> 6200 T1750 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:56424
[junit4:junit4]   2> 6202 T1752 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ad41441220005 with negotiated timeout 5000 for client /127.0.0.1:56424
[junit4:junit4]   2> 6202 T1795 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:56397, sessionid = 0x13ad41441220005, negotiated timeout = 5000
[junit4:junit4]   2> 6202 T1796 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8886d4 name:ZooKeeperConnection Watcher:127.0.0.1:56397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6203 T1748 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6204 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220005 type:create cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6205 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220005 type:create cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6208 T1748 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56419_solr
[junit4:junit4]   2> 6209 T1753 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ad41441220005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56419_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56419_solr
[junit4:junit4]   2> 6209 T1748 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56419_solr
[junit4:junit4]   2> 6212 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 6212 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2)
[junit4:junit4]   2> 6213 T1784 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 6213 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 6213 T1748 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 6214 T1748 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6214 T1768 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 6215 T1773 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 6215 T1748 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 6222 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6222 T1748 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6223 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6223 T1748 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6224 T1748 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6224 T1748 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6225 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 6238 T1748 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4]   2> 6247 T1748 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\collection1
[junit4:junit4]   2> 6248 T1748 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6248 T1748 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6249 T1748 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6251 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\collection1\'
[junit4:junit4]   2> 6252 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6253 T1748 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795/collection1/lib/README' to classloader
[junit4:junit4]   2> 6300 T1748 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6377 T1748 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6379 T1748 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6383 T1748 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7077 T1748 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7089 T1748 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7094 T1748 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7109 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7115 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7119 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7121 T1748 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7122 T1748 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-jetty2-1352177833795\collection1\, dataDir=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/jetty2\
[junit4:junit4]   2> 7122 T1748 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13a0212
[junit4:junit4]   2> 7123 T1748 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7125 T1748 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.NIOFSDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\index4599146000tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@1abdae7) assuming 'simple'
[junit4:junit4]   2> 7127 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2 forceNew:false
[junit4:junit4]   2> 7128 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2
[junit4:junit4]   2> 7128 T1748 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.RecoveryZkTest-1352177828119/jetty2\index/
[junit4:junit4]   2> 7129 T1748 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7130 T1748 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2\index forceNew:false
[junit4:junit4]   2> 7135 T1748 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f709d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@176ce73),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7135 T1748 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7137 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2\index
[junit4:junit4]   2> 7137 T1748 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7141 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7141 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7142 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7143 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7144 T1748 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7145 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7147 T1748 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7148 T1748 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7151 T1748 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7153 T1748 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7155 T1748 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7157 T1748 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7159 T1748 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7160 T1748 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7160 T1748 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7161 T1748 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7163 T1748 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7164 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7165 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7166 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7167 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7169 T1748 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7170 T1748 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7170 T1748 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7173 T1748 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7187 T1748 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7195 T1748 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7197 T1748 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7200 T1748 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2
[junit4:junit4]   2> 7200 T1748 oass.SolrIndexSearcher.<init> Opening Searcher@d14f1e main
[junit4:junit4]   2> 7202 T1748 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7203 T1748 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7203 T1748 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7222 T1748 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7320 T1797 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d14f1e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7324 T1748 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7652 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 7653 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":null,
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"down",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56419_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56419/solr"}
[junit4:junit4]   2> 7661 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7661 T1796 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7661 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7663 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 7819 T1748 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 7820 T1748 oasc.ZkController.register Register shard - core:collection1 address:http://127.0.0.1:56419/solr shardId:shard1
[junit4:junit4]   2> 7826 T1748 oasc.ZkController.register We are http://127.0.0.1:56419/solr/collection1/ and leader is http://127.0.0.1:56413/solr/collection1/
[junit4:junit4]   2> 7826 T1748 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56419/solr
[junit4:junit4]   2> 7827 T1748 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 7827 T1748 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C140 name=collection1 org.apache.solr.core.SolrCore@1a98255 url=http://127.0.0.1:56419/solr/collection1 node=127.0.0.1:56419_solr
[junit4:junit4]   2> 7829 T1798 C140 P56419 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 7829 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 7830 T1798 C140 P56419 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 7831 T1798 C140 P56419 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7831 T1748 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 7832 T1748 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 7832 T1748 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7833 T1798 C140 P56419 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:56413/solr/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 7833 T1798 C140 P56419 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56419/solr START replicas=[http://127.0.0.1:56413/solr/collection1/] nUpdates=100
[junit4:junit4]   2> 7834 T1798 C140 P56419 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 7836 T1798 C140 P56419 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 7836 T1798 C140 P56419 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 7836 T1798 C140 P56419 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 7845 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> ASYNC  NEW_CORE C141 name=collection1 org.apache.solr.core.SolrCore@b4a619 url=http://127.0.0.1:56413/solr/collection1 node=127.0.0.1:56413_solr
[junit4:junit4]   2> 7852 T1782 C141 P56413 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2
[junit4:junit4]   2> ASYNC  NEW_CORE C142 name=collection1 org.apache.solr.core.SolrCore@4c301d url=http://127.0.0.1:56404/solr/collection1 node=127.0.0.1:56404_solr
[junit4:junit4]   2> 7860 T1766 C142 P56404 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\control\data
[junit4:junit4]   2> 7864 T1766 C142 P56404 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c667e3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f69182),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7865 T1766 C142 P56404 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7874 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[1 (1417861226536370176)]} 0 14
[junit4:junit4]   2> 7874 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10001 (1417861226535321600)]} 0 15
[junit4:junit4]   2> 7880 T1778 C141 P56413 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty1
[junit4:junit4]   2> 7885 T1778 C141 P56413 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@17b8f60 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ca3bd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7886 T1778 C141 P56413 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7890 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10001 (1417861226556293121)]} 0 11
[junit4:junit4]   2> 7890 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[1 (1417861226556293120)]} 0 11
[junit4:junit4]   2> 7897 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[2 (1417861226574118912)]} 0 2
[junit4:junit4]   2> 7900 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10002 (1417861226577264640)]} 0 1
[junit4:junit4]   2> 7902 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[2 (1417861226579361792)]} 0 1
[junit4:junit4]   2> 7906 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10002 (1417861226582507520)]} 0 2
[junit4:junit4]   2> 7907 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[3 (1417861226584604672)]} 0 1
[junit4:junit4]   2> 7912 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10003 (1417861226589847552)]} 0 1
[junit4:junit4]   2> 7912 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[3 (1417861226589847552)]} 0 1
[junit4:junit4]   2> 7914 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[4 (1417861226592993280)]} 0 0
[junit4:junit4]   2> 7914 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10003 (1417861226592993280)]} 0 0
[junit4:junit4]   2> 7918 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10004 (1417861226596139008)]} 0 1
[junit4:junit4]   2> 7918 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[4 (1417861226596139008)]} 0 1
[junit4:junit4]   2> 7922 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10004 (1417861226600333312)]} 0 1
[junit4:junit4]   2> 7922 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[5 (1417861226600333312)]} 0 1
[junit4:junit4]   2> 7927 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[5 (1417861226605576192)]} 0 1
[junit4:junit4]   2> 7931 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[3 (-1417861226609770496)]} 0 1
[junit4:junit4]   2> 7931 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10005 (1417861226603479040)]} 0 7
[junit4:junit4]   2> 7934 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[3 (-1417861226613964800)]} 0 0
[junit4:junit4]   2> 7935 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10005 (1417861226613964801)]} 0 1
[junit4:junit4]   2> 7939 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10003 (-1417861226617110528)]} 0 2
[junit4:junit4]   2> 7939 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[6 (1417861226617110529)]} 0 2
[junit4:junit4]   2> 7942 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10003 (-1417861226621304832)]} 0 1
[junit4:junit4]   2> 7943 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[6 (1417861226622353408)]} 0 1
[junit4:junit4]   2> 7946 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[6 (-1417861226626547713)]} 0 0
[junit4:junit4]   2> 7946 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10006 (1417861226626547712)]} 0 0
[junit4:junit4]   2> 7950 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[6 (-1417861226630742016)]} 0 0
[junit4:junit4]   2> 7952 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10006 (1417861226631790592)]} 0 1
[junit4:junit4]   2> 7954 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[7 (1417861226633887744)]} 0 1
[junit4:junit4]   2> 7954 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[10006 (-1417861226634936320)]} 0 0
[junit4:junit4]   2> 7956 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10006 (-1417861226637033472)]} 0 0
[junit4:junit4]   2> 7960 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10007 (1417861226640179200)]} 0 1
[junit4:junit4]   2> 7960 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[7 (1417861226637033473)]} 0 4
[junit4:junit4]   2> 7964 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[8 (1417861226644373504)]} 0 1
[junit4:junit4]   2> 7964 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10007 (1417861226644373504)]} 0 1
[junit4:junit4]   2> 7967 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[8 (1417861226647519232)]} 0 1
[junit4:junit4]   2> 7967 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10008 (1417861226647519232)]} 0 1
[junit4:junit4]   2> 7970 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[7 (-1417861226651713536)]} 0 0
[junit4:junit4]   2> 7971 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10008 (1417861226651713536)]} 0 1
[junit4:junit4]   2> 7973 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10007 (-1417861226654859264)]} 0 0
[junit4:junit4]   2> 7973 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[7 (-1417861226654859264)]} 0 0
[junit4:junit4]   2> 7976 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10007 (-1417861226658004992)]} 0 0
[junit4:junit4]   2> 7976 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[9 (1417861226658004992)]} 0 0
[junit4:junit4]   2> 7980 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[9 (1417861226661150720)]} 0 1
[junit4:junit4]   2> 7983 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[8 (-1417861226665345025)]} 0 0
[junit4:junit4]   2> 7983 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10009 (1417861226665345024)]} 0 0
[junit4:junit4]   2> 7986 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[8 (-1417861226668490752)]} 0 0
[junit4:junit4]   2> 7987 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10009 (1417861226668490753)]} 0 1
[junit4:junit4]   2> 7989 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10 (1417861226670587904)]} 0 1
[junit4:junit4]   2> 7989 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10008 (-1417861226671636480)]} 0 0
[junit4:junit4]   2> 7993 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10008 (-1417861226675830785)]} 0 0
[junit4:junit4]   2> 7993 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10 (1417861226675830784)]} 0 0
[junit4:junit4]   2> 7997 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[10 (-1417861226680025088)]} 0 0
[junit4:junit4]   2> 8001 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10010 (1417861226677927936)]} 0 6
[junit4:junit4]   2> 8002 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10 (-1417861226684219392)]} 0 1
[junit4:junit4]   2> 8005 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10010 (1417861226687365120)]} 0 1
[junit4:junit4]   2> 8005 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[11 (1417861226687365120)]} 0 1
[junit4:junit4]   2> 8007 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10010 (-1417861226690510848)]} 0 0
[junit4:junit4]   2> 8008 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[11 (1417861226690510848)]} 0 1
[junit4:junit4]   2> 8010 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[11 (-1417861226693656576)]} 0 0
[junit4:junit4]   2> 8010 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10010 (-1417861226693656576)]} 0 0
[junit4:junit4]   2> 8013 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[11 (-1417861226696802304)]} 0 0
[junit4:junit4]   2> 8014 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10011 (1417861226696802304)]} 0 1
[junit4:junit4]   2> 8017 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[12 (1417861226699948032)]} 0 1
[junit4:junit4]   2> 8017 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10011 (1417861226699948032)]} 0 1
[junit4:junit4]   2> 8019 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10011 (-1417861226703093760)]} 0 0
[junit4:junit4]   2> 8020 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[12 (1417861226703093760)]} 0 1
[junit4:junit4]   2> 8022 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[10011 (-1417861226706239488)]} 0 0
[junit4:junit4]   2> 8023 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[13 (1417861226707288064)]} 0 0
[junit4:junit4]   2> 8026 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10012 (1417861226709385216)]} 0 1
[junit4:junit4]   2> 8029 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10012 (1417861226712530944)]} 0 1
[junit4:junit4]   2> 8032 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[13 (1417861226710433792)]} 0 6
[junit4:junit4]   2> 8035 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10013 (1417861226719870976)]} 0 1
[junit4:junit4]   2> 8037 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[14 (1417861226720919552)]} 0 1
[junit4:junit4]   2> 8038 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10013 (1417861226723016704)]} 0 0
[junit4:junit4]   2> 8038 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[14 (1417861226723016705)]} 0 0
[junit4:junit4]   2> 8042 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[14 (-1417861226727211008)]} 0 0
[junit4:junit4]   2> 8045 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10014 (1417861226729308160)]} 0 1
[junit4:junit4]   2> 8046 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[14 (-1417861226730356736)]} 0 1
[junit4:junit4]   2> 8049 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10014 (1417861226733502464)]} 0 1
[junit4:junit4]   2> 8049 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[15 (1417861226733502464)]} 0 1
[junit4:junit4]   2> 8051 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10014 (-1417861226736648192)]} 0 0
[junit4:junit4]   2> 8051 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[15 (1417861226736648192)]} 0 0
[junit4:junit4]   2> 8053 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10014 (-1417861226738745344)]} 0 0
[junit4:junit4]   2> 8059 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10015 (1417861226741891072)]} 0 3
[junit4:junit4]   2> 8062 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[16 (1417861226740842496)]} 0 8
[junit4:junit4]   2> 8065 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10015 (1417861226750279680)]} 0 1
[junit4:junit4]   2> 8066 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[16 (1417861226751328256)]} 0 1
[junit4:junit4]   2> 8068 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[15 (-1417861226754473985)]} 0 0
[junit4:junit4]   2> 8068 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10016 (1417861226754473984)]} 0 0
[junit4:junit4]   2> 8071 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[15 (-1417861226757619712)]} 0 0
[junit4:junit4]   2> 8072 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10016 (1417861226757619713)]} 0 1
[junit4:junit4]   2> 8074 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10015 (-1417861226760765441)]} 0 0
[junit4:junit4]   2> 8076 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[17 (1417861226760765440)]} 0 2
[junit4:junit4]   2> 8079 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10015 (-1417861226764959744)]} 0 1
[junit4:junit4]   2> 8080 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[17 (1417861226766008320)]} 0 1
[junit4:junit4]   2> 8082 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10017 (1417861226769154048)]} 0 1
[junit4:junit4]   2> 8084 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[18 (1417861226770202624)]} 0 1
[junit4:junit4]   2> 8085 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10017 (1417861226772299776)]} 0 0
[junit4:junit4]   2> 8087 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[18 (1417861226773348352)]} 0 1
[junit4:junit4]   2> 8088 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10018 (1417861226774396928)]} 0 1
[junit4:junit4]   2> 8088 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[18 (-1417861226775445504)]} 0 0
[junit4:junit4]   2> 8091 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[18 (-1417861226778591232)]} 0 0
[junit4:junit4]   2> 8096 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10018 (1417861226777542656)]} 0 6
[junit4:junit4]   2> 8098 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[19 (1417861226785931264)]} 0 1
[junit4:junit4]   2> 8101 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10018 (-1417861226788028416)]} 0 1
[junit4:junit4]   2> 8103 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10018 (-1417861226791174144)]} 0 0
[junit4:junit4]   2> 8107 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[19 (1417861226793271296)]} 0 2
[junit4:junit4]   2> 8121 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10019 (1417861226808999936)]} 0 2
[junit4:junit4]   2> 8123 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[20 (1417861226812145664)]} 0 0
[junit4:junit4]   2> 8126 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10019 (1417861226814242816)]} 0 1
[junit4:junit4]   2> 8131 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[20 (1417861226817388544)]} 0 3
[junit4:junit4]   2> 8135 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10020 (1417861226819485696)]} 0 5
[junit4:junit4]   2> 8138 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[20 (-1417861226827874304)]} 0 1
[junit4:junit4]   2> 8140 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10020 (1417861226829971456)]} 0 0
[junit4:junit4]   2> 8143 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[20 (-1417861226833117184)]} 0 0
[junit4:junit4]   2> 8145 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10020 (-1417861226835214336)]} 0 0
[junit4:junit4]   2> 8149 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10020 (-1417861226839408640)]} 0 0
[junit4:junit4]   2> 8156 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10021 (1417861226845700096)]} 0 1
[junit4:junit4]   2> 8158 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[21 (1417861226848845824)]} 0 0
[junit4:junit4]   2> 8161 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10021 (1417861226851991552)]} 0 1
[junit4:junit4]   2> 8161 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[21 (1417861226851991553)]} 0 0
[junit4:junit4]   2> 8164 T1769 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4]   2> 8166 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10022 (1417861226855137280)]} 0 2
[junit4:junit4]   2> 8167 T1769 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2>  "operation":"state",
[junit4:junit4]   2>  "numShards":"1",
[junit4:junit4]   2>  "shard":"shard1",
[junit4:junit4]   2>  "roles":null,
[junit4:junit4]   2>  "state":"recovering",
[junit4:junit4]   2>  "core":"collection1",
[junit4:junit4]   2>  "collection":"collection1",
[junit4:junit4]   2>  "node_name":"127.0.0.1:56419_solr",
[junit4:junit4]   2>  "base_url":"http://127.0.0.1:56419/solr"}
[junit4:junit4]   2> 8167 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[22 (1417861226857234432)]} 0 1
[junit4:junit4]   2> 8171 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10022 (1417861226861428736)]} 0 1
[junit4:junit4]   2> 8171 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[22 (1417861226860380160)]} 0 2
[junit4:junit4]   2> 8175 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[23 (1417861226865623040)]} 0 1
[junit4:junit4]   2> 8175 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10023 (1417861226866671616)]} 0 0
[junit4:junit4]   2> 8177 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[23 (1417861226868768768)]} 0 0
[junit4:junit4]   2> 8180 T1773 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 8180 T1768 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 8180 T1796 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 8179 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10023 (1417861226870865920)]} 0 0
[junit4:junit4]   2> 8181 T1784 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (3)
[junit4:junit4]   2> 8181 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[24 (1417861226872963072)]} 0 0
[junit4:junit4]   2> 8186 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[24 (1417861226877157376)]} 0 1
[junit4:junit4]   2> 8184 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10024 (1417861226875060224)]} 0 1
[junit4:junit4]   2> 8187 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[23 (-1417861226879254528)]} 0 0
[junit4:junit4]   2>  C140_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56419_solr, base_url=http://127.0.0.1:56419/solr}
[junit4:junit4]   2> 8197 T1791 C140 P56419 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.RecoveryZkTest-1352177828119\jetty2
[junit4:junit4]   2> 8203 T1791 C140 P56419 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f709d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@176ce73),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8204 T1791 C140 P56419 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8207 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=8
[junit4:junit4]   2> 8207 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=11
[junit4:junit4]   2> 8208 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[23 (-1417861226882400256)]} 0 18
[junit4:junit4]   2> 8209 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10024 (1417861226880303104)]} 0 21
[junit4:junit4]   2> 8211 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[25 (1417861226904420352)]} 0 0
[junit4:junit4]   2> 8211 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10023 (-1417861226904420353)]} 0 0
[junit4:junit4]   2> 8219 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8220 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10023 (-1417861226907566080)]} 0 6
[junit4:junit4]   2> 8228 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8228 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[25 (1417861226906517504)]} 0 15
[junit4:junit4]   2> 8232 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10025 (1417861226921197568)]} 0 5
[junit4:junit4]   2> 8235 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[26 (1417861226928537600)]} 0 1
[junit4:junit4]   2> 8240 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8241 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10025 (1417861226929586176)]} 0 6
[junit4:junit4]   2> 8245 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10026 (1417861226939023360)]} 0 1
[junit4:junit4]   2> 8246 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8247 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[26 (1417861226931683328)]} 0 10
[junit4:junit4]   2> 8252 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[27 (1417861226947411968)]} 0 0
[junit4:junit4]   2> 8253 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8253 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10026 (1417861226944266240)]} 0 4
[junit4:junit4]   2> 8258 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10027 (1417861226952654848)]} 0 1
[junit4:junit4]   2> 8262 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8264 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[27 (1417861226950557696)]} 0 9
[junit4:junit4]   2> 8265 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8266 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10027 (1417861226955800576)]} 0 6
[junit4:junit4]   2> 8267 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[24 (-1417861226962092032)]} 0 1
[junit4:junit4]   2> 8268 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[10024 (-1417861226964189184)]} 0 0
[junit4:junit4]   2> 8273 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8273 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8274 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[24 (-1417861226966286336)]} 0 4
[junit4:junit4]   2> 8274 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10024 (-1417861226967334912)]} 0 3
[junit4:junit4]   2> 8278 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[28 (1417861226972577792)]} 0 2
[junit4:junit4]   2> 8279 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10028 (1417861226974674944)]} 0 1
[junit4:junit4]   2> 8284 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8285 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8285 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[28 (1417861226976772096)]} 0 5
[junit4:junit4]   2> 8285 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10028 (1417861226977820672)]} 0 4
[junit4:junit4]   2> 8288 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[29 (1417861226984112128)]} 0 1
[junit4:junit4]   2> 8288 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10029 (1417861226984112129)]} 0 1
[junit4:junit4]   2> 8297 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4]   2> 8305 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10029 (1417861226988306432)]} 0 14
[junit4:junit4]   2> 8309 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=15
[junit4:junit4]   2> 8309 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[29 (1417861226988306433)]} 0 18
[junit4:junit4]   2> 8309 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10025 (-1417861227007180800)]} 0 0
[junit4:junit4]   2> 8312 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[25 (-1417861227010326528)]} 0 0
[junit4:junit4]   2> 8315 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8316 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10025 (-1417861227010326528)]} 0 4
[junit4:junit4]   2> 8317 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8318 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[25 (-1417861227013472256)]} 0 3
[junit4:junit4]   2> 8321 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10030 (1417861227017666560)]} 0 2
[junit4:junit4]   2> 8326 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[30 (1417861227019763712)]} 0 5
[junit4:junit4]   2> 8328 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8329 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10030 (1417861227022909440)]} 0 5
[junit4:junit4]   2> 8333 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10026 (-1417861227032346624)]} 0 0
[junit4:junit4]   2> 8333 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8335 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[30 (1417861227028152320)]} 0 6
[junit4:junit4]   2> 8337 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8338 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10026 (-1417861227034443776)]} 0 3
[junit4:junit4]   2> 8338 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[26 (-1417861227037589504)]} 0 0
[junit4:junit4]   2> 8341 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10031 (1417861227039686656)]} 0 1
[junit4:junit4]   2> 8344 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8345 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[26 (-1417861227041783808)]} 0 3
[junit4:junit4]   2> 8348 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8350 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10031 (1417861227043880960)]} 0 6
[junit4:junit4]   2> 8350 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[31 (1417861227049123840)]} 0 1
[junit4:junit4]   2> 8354 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10032 (1417861227053318144)]} 0 1
[junit4:junit4]   2> 8362 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8364 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8365 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10032 (1417861227057512448)]} 0 8
[junit4:junit4]   2> 8366 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[31 (1417861227053318144)]} 0 13
[junit4:junit4]   2> 8368 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10033 (1417861227069046784)]} 0 0
[junit4:junit4]   2> 8370 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[32 (1417861227071143936)]} 0 0
[junit4:junit4]   2> 8377 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 8378 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10033 (1417861227074289664)]} 0 5
[junit4:junit4]   2> 8381 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8382 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[10027 (-1417861227083726848)]} 0 0
[junit4:junit4]   2> 8384 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[32 (1417861227079532544)]} 0 6
[junit4:junit4]   2> 8387 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8391 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[33 (1417861227091066880)]} 0 1
[junit4:junit4]   2> 8392 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10027 (-1417861227085824000)]} 0 8
[junit4:junit4]   2> 8397 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10034 (1417861227098406912)]} 0 1
[junit4:junit4]   2> 8399 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8401 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[33 (1417861227097358336)]} 0 6
[junit4:junit4]   2> 8406 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[27 (-1417861227108892672)]} 0 1
[junit4:junit4]   2> 8425 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=18
[junit4:junit4]   2> 8426 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8427 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10034 (1417861227104698368)]} 0 25
[junit4:junit4]   2> 8427 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[27 (-1417861227125669888)]} 0 5
[junit4:junit4]   2> 8429 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10028 (-1417861227133009920)]} 0 0
[junit4:junit4]   2> 8431 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[34 (1417861227135107072)]} 0 0
[junit4:junit4]   2> 8435 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8438 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10028 (-1417861227137204224)]} 0 5
[junit4:junit4]   2> 8441 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10035 (1417861227145592832)]} 0 0
[junit4:junit4]   2> 8442 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8443 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[34 (1417861227143495680)]} 0 4
[junit4:junit4]   2> 8446 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[28 (-1417861227150835712)]} 0 0
[junit4:junit4]   2> 8449 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8450 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10035 (1417861227148738560)]} 0 6
[junit4:junit4]   2> 8451 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8452 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[28 (-1417861227153981440)]} 0 3
[junit4:junit4]   2> 8456 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[35 (1417861227160272896)]} 0 1
[junit4:junit4]   2> 8457 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10036 (1417861227157127168)]} 0 5
[junit4:junit4]   2> 8463 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8463 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8463 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[35 (1417861227163418624)]} 0 5
[junit4:junit4]   2> 8464 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10036 (1417861227164467200)]} 0 5
[junit4:junit4]   2> 8467 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[36 (1417861227171807232)]} 0 1
[junit4:junit4]   2> 8468 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10037 (1417861227171807233)]} 0 2
[junit4:junit4]   2> 8473 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8474 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8474 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10037 (1417861227176001537)]} 0 4
[junit4:junit4]   2> 8475 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[36 (1417861227176001536)]} 0 5
[junit4:junit4]   2> 8477 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10038 (1417861227183341568)]} 0 0
[junit4:junit4]   2> 8479 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[37 (1417861227185438720)]} 0 1
[junit4:junit4]   2> 8485 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8486 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[37 (1417861227188584448)]} 0 4
[junit4:junit4]   2> 8488 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8491 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[38 (1417861227198021632)]} 0 0
[junit4:junit4]   2> 8491 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10038 (1417861227186487296)]} 0 11
[junit4:junit4]   2> 8495 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10035 (-1417861227202215936)]} 0 0
[junit4:junit4]   2> 8499 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8500 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[38 (1417861227202215936)]} 0 5
[junit4:junit4]   2> 8500 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8501 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[10035 (-1417861227204313088)]} 0 4
[junit4:junit4]   2> 8503 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[35 (-1417861227210604544)]} 0 0
[junit4:junit4]   2> 8506 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10039 (1417861227212701696)]} 0 1
[junit4:junit4]   2> 8508 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8508 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[35 (-1417861227213750272)]} 0 2
[junit4:junit4]   2> 8513 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[39 (1417861227220041728)]} 0 1
[junit4:junit4]   2> 8514 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4]   2> 8515 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10039 (1417861227215847424)]} 0 7
[junit4:junit4]   2> 8519 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10040 (1417861227226333184)]} 0 1
[junit4:junit4]   2> 8523 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 8523 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[39 (1417861227225284608)]} 0 6
[junit4:junit4]   2> 8527 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8529 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10040 (1417861227233673216)]} 0 4
[junit4:junit4]   2> 8572 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10041 (1417861227281907712)]} 0 1
[junit4:junit4]   2> 8583 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8585 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10041 (1417861227286102016)]} 0 10
[junit4:junit4]   2> 8637 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10042 (1417861227299733504)]} 0 49
[junit4:junit4]   2> 8647 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[40 (1417861227238916096)]} 0 117
[junit4:junit4]   2> 8729 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8733 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10042 (1417861227363696640)]} 0 85
[junit4:junit4]   2> 8736 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8737 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[40 (1417861227448631296)]} 0 7
[junit4:junit4]   2> 8738 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10042 (-1417861227457019904)]} 0 0
[junit4:junit4]   2> 8741 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[41 (1417861227460165632)]} 0 0
[junit4:junit4]   2> 8747 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8748 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10042 (-1417861227463311360)]} 0 4
[junit4:junit4]   2> 8750 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8753 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10043 (1417861227471699968)]} 0 2
[junit4:junit4]   2> 8754 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[41 (1417861227464359936)]} 0 9
[junit4:junit4]   2> 8759 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[42 (1417861227477991424)]} 0 1
[junit4:junit4]   2> 8765 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8767 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8769 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[42 (1417861227483234304)]} 0 6
[junit4:junit4]   2> 8769 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10043 (1417861227480088576)]} 0 9
[junit4:junit4]   2> 8771 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[42 (-1417861227491622912)]} 0 0
[junit4:junit4]   2> 8771 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10044 (1417861227491622913)]} 0 0
[junit4:junit4]   2> 8778 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8779 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[42 (-1417861227495817216)]} 0 4
[junit4:junit4]   2> 8783 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[43 (1417861227502108672)]} 0 2
[junit4:junit4]   2> 8789 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8791 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[43 (1417861227507351552)]} 0 5
[junit4:junit4]   2> 8796 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[44 (1417861227516788736)]} 0 1
[junit4:junit4]   2> 8802 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4]   2> 8804 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10044 (1417861227495817217)]} 0 29
[junit4:junit4]   2> 8805 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8806 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[44 (1417861227522031616)]} 0 6
[junit4:junit4]   2> 8807 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10045 (1417861227529371648)]} 0 0
[junit4:junit4]   2> 8815 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[45 (1417861227531468800)]} 0 6
[junit4:junit4]   2> 8817 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8818 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10045 (1417861227533565952)]} 0 7
[junit4:junit4]   2> 8820 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[10043 (-1417861227543003136)]} 0 0
[junit4:junit4]   2> 8828 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 8828 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10043 (-1417861227546148864)]} 0 5
[junit4:junit4]   2> 8829 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8830 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[45 (1417861227540905984)]} 0 12
[junit4:junit4]   2> 8833 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10046 (1417861227555586048)]} 0 1
[junit4:junit4]   2> 8834 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[43 (-1417861227557683200)]} 0 1
[junit4:junit4]   2> 8848 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8848 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=8
[junit4:junit4]   2> 8849 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10046 (1417861227560828928)]} 0 12
[junit4:junit4]   2> 8849 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[43 (-1417861227561877504)]} 0 12
[junit4:junit4]   2> 8853 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10047 (1417861227576557569)]} 0 1
[junit4:junit4]   2> 8853 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[46 (1417861227576557568)]} 0 1
[junit4:junit4]   2> 8859 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8859 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8859 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10047 (1417861227579703296)]} 0 4
[junit4:junit4]   2> 8860 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[46 (1417861227579703297)]} 0 5
[junit4:junit4]   2> 8863 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10048 (1417861227587043328)]} 0 1
[junit4:junit4]   2> 8863 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[47 (1417861227587043329)]} 0 1
[junit4:junit4]   2> 8870 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8871 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8871 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10048 (1417861227591237632)]} 0 5
[junit4:junit4]   2> 8871 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[47 (1417861227591237633)]} 0 5
[junit4:junit4]   2> 8874 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10049 (1417861227599626240)]} 0 0
[junit4:junit4]   2> 8877 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[48 (1417861227601723392)]} 0 1
[junit4:junit4]   2> 8881 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8882 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10049 (1417861227603820544)]} 0 4
[junit4:junit4]   2> 8885 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10049 (-1417861227611160576)]} 0 0
[junit4:junit4]   2> 8887 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4]   2> 8889 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[48 (1417861227605917696)]} 0 9
[junit4:junit4]   2> 8891 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8891 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[49 (1417861227617452032)]} 0 0
[junit4:junit4]   2> 8892 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10049 (-1417861227615354880)]} 0 3
[junit4:junit4]   2> 8895 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10050 (1417861227621646336)]} 0 0
[junit4:junit4]   2> 8901 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8902 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[49 (1417861227620597760)]} 0 8
[junit4:junit4]   2> 8902 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8903 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10050 (1417861227625840640)]} 0 4
[junit4:junit4]   2> 8904 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[49 (-1417861227631083520)]} 0 0
[junit4:junit4]   2> 8909 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8910 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10051 (1417861227633180672)]} 0 4
[junit4:junit4]   2> 8910 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[49 (-1417861227633180672)]} 0 4
[junit4:junit4]   2> 8914 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[50 (1417861227640520704)]} 0 1
[junit4:junit4]   2> 8917 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 8917 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10051 (1417861227640520704)]} 0 4
[junit4:junit4]   2> 8920 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8923 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10052 (1417861227649957888)]} 0 1
[junit4:junit4]   2> 8925 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[50 (1417861227644715008)]} 0 8
[junit4:junit4]   2> 8929 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8929 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[51 (1417861227657297920)]} 0 1
[junit4:junit4]   2> 8929 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10052 (1417861227654152192)]} 0 3
[junit4:junit4]   2> 8933 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10052 (-1417861227661492224)]} 0 0
[junit4:junit4]   2> 8939 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8940 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8940 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10052 (-1417861227664637952)]} 0 4
[junit4:junit4]   2> 8940 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[51 (1417861227662540800)]} 0 6
[junit4:junit4]   2> 8944 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10053 (1417861227671977985)]} 0 1
[junit4:junit4]   2> 8944 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[52 (1417861227671977984)]} 0 1
[junit4:junit4]   2> 8951 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8952 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10053 (1417861227675123713)]} 0 6
[junit4:junit4]   2> 8953 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8954 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[52 (1417861227675123712)]} 0 8
[junit4:junit4]   2> 8955 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10053 (-1417861227684560896)]} 0 0
[junit4:junit4]   2> 8956 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[52 (-1417861227685609472)]} 0 0
[junit4:junit4]   2> 8961 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8961 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8962 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[52 (-1417861227688755200)]} 0 3
[junit4:junit4]   2> 8962 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10053 (-1417861227687706624)]} 0 4
[junit4:junit4]   2> 8966 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[53 (1417861227695046656)]} 0 1
[junit4:junit4]   2> 8966 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10054 (1417861227695046657)]} 0 1
[junit4:junit4]   2> 8972 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8972 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[53 (1417861227698192384)]} 0 4
[junit4:junit4]   2> 8976 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4]   2> 8976 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[53 (-1417861227706580992)]} 0 1
[junit4:junit4]   2> 8977 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10054 (1417861227699240960)]} 0 8
[junit4:junit4]   2> 8979 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10055 (1417861227708678144)]} 0 1
[junit4:junit4]   2> 8981 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8982 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[53 (-1417861227708678144)]} 0 4
[junit4:junit4]   2> 8985 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[54 (1417861227716018176)]} 0 0
[junit4:junit4]   2> 8987 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8988 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10055 (1417861227712872448)]} 0 6
[junit4:junit4]   2> 8991 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10054 (-1417861227722309632)]} 0 0
[junit4:junit4]   2> 8992 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 8993 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[54 (1417861227719163904)]} 0 5
[junit4:junit4]   2> 8998 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 8998 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10054 (-1417861227725455360)]} 0 4
[junit4:junit4]   2> 8999 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[55 (1417861227726503936)]} 0 4
[junit4:junit4]   2> 9002 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10056 (1417861227732795392)]} 0 1
[junit4:junit4]   2> 9003 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9004 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[55 (1417861227732795392)]} 0 3
[junit4:junit4]   2> 9008 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[54 (-1417861227740135424)]} 0 0
[junit4:junit4]   2> 9012 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9013 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10056 (1417861227735941120)]} 0 9
[junit4:junit4]   2> 9014 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9015 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[54 (-1417861227743281152)]} 0 4
[junit4:junit4]   2> 9015 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10057 (1417861227747475456)]} 0 0
[junit4:junit4]   2> 9017 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[56 (1417861227749572608)]} 0 0
[junit4:junit4]   2> 9021 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9022 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10057 (1417861227750621184)]} 0 4
[junit4:junit4]   2> 9024 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9024 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[56 (1417861227752718336)]} 0 4
[junit4:junit4]   2> 9025 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10056 (-1417861227757961216)]} 0 0
[junit4:junit4]   2> 9027 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[57 (1417861227759009792)]} 0 1
[junit4:junit4]   2> 9029 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9030 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10056 (-1417861227760058368)]} 0 3
[junit4:junit4]   2> 9032 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9032 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10058 (1417861227765301248)]} 0 0
[junit4:junit4]   2> 9033 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[57 (1417861227762155520)]} 0 4
[junit4:junit4]   2> 9037 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[56 (-1417861227770544128)]} 0 0
[junit4:junit4]   2> 9040 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9040 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10058 (1417861227768446976)]} 0 5
[junit4:junit4]   2> 9042 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9043 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[56 (-1417861227773689856)]} 0 3
[junit4:junit4]   2> 9044 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10059 (1417861227776835584)]} 0 1
[junit4:junit4]   2> 9052 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[58 (1417861227786272768)]} 0 0
[junit4:junit4]   2> 9058 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9059 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10059 (1417861227788369920)]} 0 5
[junit4:junit4]   2> 9062 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10058 (-1417861227796758528)]} 0 0
[junit4:junit4]   2> 9062 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4]   2> 9063 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[58 (1417861227790467072)]} 0 7
[junit4:junit4]   2> 9065 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[59 (1417861227799904256)]} 0 0
[junit4:junit4]   2> 9066 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9067 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10058 (-1417861227798855680)]} 0 3
[junit4:junit4]   2> 9069 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10060 (1417861227804098560)]} 0 0
[junit4:junit4]   2> 9072 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9074 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[59 (1417861227803049984)]} 0 6
[junit4:junit4]   2> 9075 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9075 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10060 (1417861227807244288)]} 0 3
[junit4:junit4]   2> 9076 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[58 (-1417861227811438592)]} 0 0
[junit4:junit4]   2> 9078 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10059 (-1417861227813535744)]} 0 0
[junit4:junit4]   2> 9082 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9083 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[58 (-1417861227814584320)]} 0 4
[junit4:junit4]   2> 9084 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9085 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10059 (-1417861227816681472)]} 0 4
[junit4:junit4]   2> 9087 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10061 (1417861227822972928)]} 0 0
[junit4:junit4]   2> 9088 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[60 (1417861227820875776)]} 0 3
[junit4:junit4]   2> 9095 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9095 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9096 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10061 (1417861227826118657)]} 0 6
[junit4:junit4]   2> 9096 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[60 (1417861227826118656)]} 0 6
[junit4:junit4]   2> 9098 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[59 (-1417861227834507264)]} 0 0
[junit4:junit4]   2> 9099 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10062 (1417861227834507265)]} 0 0
[junit4:junit4]   2> 9103 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9104 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[59 (-1417861227836604416)]} 0 4
[junit4:junit4]   2> 9104 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9105 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10062 (1417861227837652992)]} 0 4
[junit4:junit4]   2> 9107 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[61 (1417861227842895872)]} 0 1
[junit4:junit4]   2> 9108 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10063 (1417861227844993024)]} 0 0
[junit4:junit4]   2> 9114 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9115 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10063 (1417861227848138752)]} 0 4
[junit4:junit4]   2> 9115 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9116 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[61 (1417861227847090176)]} 0 6
[junit4:junit4]   2> 9119 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10064 (1417861227855478784)]} 0 1
[junit4:junit4]   2> 9122 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[62 (1417861227857575936)]} 0 2
[junit4:junit4]   2> 9126 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9128 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9129 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[62 (1417861227862818816)]} 0 4
[junit4:junit4]   2> 9130 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10064 (1417861227860721664)]} 0 7
[junit4:junit4]   2> 9133 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[63 (1417861227871207424)]} 0 0
[junit4:junit4]   2> 9134 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[10061 (-1417861227872256000)]} 0 0
[junit4:junit4]   2> 9140 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9141 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[10061 (-1417861227876450304)]} 0 3
[junit4:junit4]   2> 9145 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10065 (1417861227883790336)]} 0 0
[junit4:junit4]   2> 9150 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9150 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10065 (1417861227886936064)]} 0 2
[junit4:junit4]   2> 9153 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=12
[junit4:junit4]   2> 9153 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[63 (1417861227875401728)]} 0 16
[junit4:junit4]   2> 9153 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10066 (1417861227892178944)]} 0 0
[junit4:junit4]   2> 9159 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9162 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[64 (1417861227896373248)]} 0 6
[junit4:junit4]   2> 9162 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10066 (1417861227895324672)]} 0 6
[junit4:junit4]   2> 9167 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10067 (1417861227904761856)]} 0 2
[junit4:junit4]   2> 9172 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9172 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[64 (1417861227908956160)]} 0 3
[junit4:junit4]   2> 9174 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[61 (-1417861227914199040)]} 0 0
[junit4:junit4]   2> 9175 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9176 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10067 (1417861227911053312)]} 0 5
[junit4:junit4]   2> 9178 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10068 (1417861227918393344)]} 0 0
[junit4:junit4]   2> 9179 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9180 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[61 (-1417861227917344768)]} 0 3
[junit4:junit4]   2> 9182 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[65 (1417861227922587648)]} 0 0
[junit4:junit4]   2> 9185 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9186 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10068 (1417861227921539072)]} 0 5
[junit4:junit4]   2> 9192 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9193 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[65 (1417861227925733376)]} 0 8
[junit4:junit4]   2> 9194 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10069 (1417861227935170560)]} 0 1
[junit4:junit4]   2> 9197 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[66 (1417861227937267712)]} 0 1
[junit4:junit4]   2> 9199 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9199 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10069 (1417861227937267712)]} 0 3
[junit4:junit4]   2> 9201 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[10062 (-1417861227942510592)]} 0 0
[junit4:junit4]   2> 9203 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9204 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[66 (1417861227940413440)]} 0 5
[junit4:junit4]   2> 9206 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[67 (1417861227947753472)]} 0 0
[junit4:junit4]   2> 9207 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9208 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[10062 (-1417861227945656320)]} 0 4
[junit4:junit4]   2> 9211 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10070 (1417861227952996352)]} 0 0
[junit4:junit4]   2> 9222 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9222 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10070 (1417861227958239232)]} 0 6
[junit4:junit4]   2> 9224 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[10063 (-1417861227966627840)]} 0 0
[junit4:junit4]   2> 9224 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 9225 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[67 (1417861227950899200)]} 0 16
[junit4:junit4]   2> 9227 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[68 (1417861227969773568)]} 0 0
[junit4:junit4]   2> 9229 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9230 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10063 (-1417861227968724992)]} 0 4
[junit4:junit4]   2> 9233 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10071 (1417861227976065024)]} 0 0
[junit4:junit4]   2> 9235 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9236 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[68 (1417861227973967872)]} 0 5
[junit4:junit4]   2> 9239 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9241 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10071 (1417861227979210752)]} 0 5
[junit4:junit4]   2> 9242 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[69 (1417861227981307904)]} 0 4
[junit4:junit4]   2> 9244 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10065 (-1417861227987599360)]} 0 0
[junit4:junit4]   2> 9248 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9248 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9249 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10065 (-1417861227989696512)]} 0 3
[junit4:junit4]   2> 9249 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[69 (1417861227989696513)]} 0 3
[junit4:junit4]   2> 9252 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10072 (1417861227994939392)]} 0 1
[junit4:junit4]   2> 9252 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[62 (-1417861227995987968)]} 0 0
[junit4:junit4]   2> 9258 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9258 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9259 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[62 (-1417861228000182272)]} 0 3
[junit4:junit4]   2> 9259 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10072 (1417861227999133696)]} 0 4
[junit4:junit4]   2> 9261 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[70 (1417861228005425152)]} 0 0
[junit4:junit4]   2> 9262 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10066 (-1417861228006473728)]} 0 0
[junit4:junit4]   2> 9267 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9267 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9268 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10066 (-1417861228009619456)]} 0 3
[junit4:junit4]   2> 9268 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[70 (1417861228008570880)]} 0 4
[junit4:junit4]   2> 9270 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[63 (-1417861228014862336)]} 0 0
[junit4:junit4]   2> 9270 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10073 (1417861228014862337)]} 0 0
[junit4:junit4]   2> 9274 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9275 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[63 (-1417861228018008064)]} 0 2
[junit4:junit4]   2> 9275 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9276 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10073 (1417861228018008065)]} 0 3
[junit4:junit4]   2> 9278 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[71 (1417861228023250944)]} 0 1
[junit4:junit4]   2> 9280 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10074 (1417861228024299520)]} 0 1
[junit4:junit4]   2> 9285 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9286 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[71 (1417861228027445248)]} 0 5
[junit4:junit4]   2> 9289 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 9290 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[65 (-1417861228035833856)]} 0 0
[junit4:junit4]   2> 9290 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10074 (1417861228028493824)]} 0 7
[junit4:junit4]   2> 9294 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10068 (-1417861228038979584)]} 0 1
[junit4:junit4]   2> 9297 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9297 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[65 (-1417861228038979584)]} 0 4
[junit4:junit4]   2> 9298 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9299 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10068 (-1417861228042125312)]} 0 3
[junit4:junit4]   2> 9302 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[72 (1417861228047368192)]} 0 2
[junit4:junit4]   2> 9303 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10075 (1417861228048416768)]} 0 1
[junit4:junit4]   2> 9309 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9310 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[72 (1417861228052611072)]} 0 5
[junit4:junit4]   2> 9314 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[66 (-1417861228060999680)]} 0 0
[junit4:junit4]   2> 9316 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=7
[junit4:junit4]   2> 9317 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10075 (1417861228052611073)]} 0 11
[junit4:junit4]   2> 9321 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9322 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[66 (-1417861228065193984)]} 0 5
[junit4:junit4]   2> 9322 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10076 (1417861228069388288)]} 0 0
[junit4:junit4]   2> 9327 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[73 (1417861228074631168)]} 0 1
[junit4:junit4]   2> 9336 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9338 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[73 (1417861228077776896)]} 0 8
[junit4:junit4]   2> 9340 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 9341 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10076 (1417861228073582592)]} 0 15
[junit4:junit4]   2> 9346 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10077 (1417861228092456960)]} 0 2
[junit4:junit4]   2> 9354 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9356 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10077 (1417861228097699840)]} 0 7
[junit4:junit4]   2> 9362 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10072 (-1417861228109234176)]} 0 2
[junit4:junit4]   2> 9367 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9368 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[10072 (-1417861228113428480)]} 0 4
[junit4:junit4]   2> 9368 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[74 (1417861228090359808)]} 0 26
[junit4:junit4]   2> 9372 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10078 (1417861228120768512)]} 0 1
[junit4:junit4]   2> 9375 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9376 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[74 (1417861228121817088)]} 0 4
[junit4:junit4]   2> 9388 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[68 (-1417861228138594304)]} 0 0
[junit4:junit4]   2> 9388 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9389 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10078 (1417861228124962816)]} 0 14
[junit4:junit4]   2> 9391 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10079 (1417861228141740032)]} 0 0
[junit4:junit4]   2> 9393 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9394 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[68 (-1417861228141740032)]} 0 3
[junit4:junit4]   2> 9397 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9397 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[75 (1417861228148031488)]} 0 0
[junit4:junit4]   2> 9399 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10079 (1417861228144885760)]} 0 5
[junit4:junit4]   2> 9407 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10080 (1417861228158517248)]} 0 2
[junit4:junit4]   2> 9409 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9410 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[75 (1417861228158517248)]} 0 3
[junit4:junit4]   2> 9412 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9413 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10080 (1417861228161662976)]} 0 3
[junit4:junit4]   2> 9414 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[76 (1417861228164808704)]} 0 1
[junit4:junit4]   2> 9417 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[10074 (-1417861228169003008)]} 0 0
[junit4:junit4]   2> 9421 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9421 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[76 (1417861228169003008)]} 0 4
[junit4:junit4]   2> 9422 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9423 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10074 (-1417861228173197312)]} 0 2
[junit4:junit4]   2> 9424 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[77 (1417861228176343040)]} 0 0
[junit4:junit4]   2> 9425 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10081 (1417861228177391616)]} 0 0
[junit4:junit4]   2> 9432 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9433 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10081 (1417861228180537344)]} 0 5
[junit4:junit4]   2> 9436 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6
[junit4:junit4]   2> 9437 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[77 (1417861228179488768)]} 0 10
[junit4:junit4]   2> 9439 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10082 (1417861228191023104)]} 0 1
[junit4:junit4]   2> 9441 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[72 (-1417861228194168832)]} 0 0
[junit4:junit4]   2> 9460 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9460 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9461 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10082 (1417861228195217408)]} 0 19
[junit4:junit4]   2> 9461 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[72 (-1417861228206751744)]} 0 8
[junit4:junit4]   2> 9478 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[10077 (-1417861228232966144)]} 0 0
[junit4:junit4]   2> 9482 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[78 (1417861228231917568)]} 0 5
[junit4:junit4]   2> 9489 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9491 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10077 (-1417861228242403328)]} 0 4
[junit4:junit4]   2> 9493 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10083 (1417861228248694784)]} 0 0
[junit4:junit4]   2> 9566 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9568 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9568 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10083 (1417861228250791936)]} 0 73
[junit4:junit4]   2> 9568 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[78 (1417861228240306176)]} 0 83
[junit4:junit4]   2> 9569 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10078 (-1417861228328386560)]} 0 0
[junit4:junit4]   2> 9570 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[79 (1417861228329435136)]} 0 0
[junit4:junit4]   2> 9578 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9579 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9580 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10078 (-1417861228332580864)]} 0 7
[junit4:junit4]   2> 9581 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[79 (1417861228333629440)]} 0 7
[junit4:junit4]   2> 9584 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[80 (1417861228344115200)]} 0 0
[junit4:junit4]   2> 9586 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10084 (1417861228345163776)]} 0 1
[junit4:junit4]   2> 9590 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9590 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[80 (1417861228347260928)]} 0 3
[junit4:junit4]   2> 9592 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9592 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10084 (1417861228349358080)]} 0 3
[junit4:junit4]   2> 9594 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[74 (-1417861228353552384)]} 0 1
[junit4:junit4]   2> 9594 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10084 (-1417861228354600960)]} 0 0
[junit4:junit4]   2> 9608 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9609 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9609 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[74 (-1417861228356698112)]} 0 13
[junit4:junit4]   2> 9610 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[10084 (-1417861228357746688)]} 0 13
[junit4:junit4]   2> 9614 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10085 (1417861228375572480)]} 0 1
[junit4:junit4]   2> 9614 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[81 (1417861228374523904)]} 0 1
[junit4:junit4]   2> 9621 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9622 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9622 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10085 (1417861228379766784)]} 0 4
[junit4:junit4]   2> 9623 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[81 (1417861228378718208)]} 0 6
[junit4:junit4]   2> 9626 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10086 (1417861228388155392)]} 0 1
[junit4:junit4]   2> 9626 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[82 (1417861228387106816)]} 0 1
[junit4:junit4]   2> 9636 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9637 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[10086 (1417861228394446848)]} 0 6
[junit4:junit4]   2> 9640 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=6
[junit4:junit4]   2> 9641 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[82 (1417861228392349696)]} 0 11
[junit4:junit4]   2> 9643 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10087 (1417861228404932608)]} 0 1
[junit4:junit4]   2> 9644 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[77 (-1417861228407029760)]} 0 0
[junit4:junit4]   2> 9647 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9649 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10087 (1417861228407029760)]} 0 5
[junit4:junit4]   2> 9650 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9650 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[77 (-1417861228409126912)]} 0 4
[junit4:junit4]   2> 9656 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[83 (1417861228416466944)]} 0 3
[junit4:junit4]   2> 9657 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10086 (-1417861228420661248)]} 0 0
[junit4:junit4]   2> 9662 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9662 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9663 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[83 (1417861228422758400)]} 0 4
[junit4:junit4]   2> 9665 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[10086 (-1417861228423806976)]} 0 5
[junit4:junit4]   2> 9666 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[78 (-1417861228430098432)]} 0 0
[junit4:junit4]   2> 9668 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10088 (1417861228431147008)]} 0 1
[junit4:junit4]   2> 9670 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9672 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[78 (-1417861228432195584)]} 0 4
[junit4:junit4]   2> 9673 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9674 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10088 (1417861228435341312)]} 0 3
[junit4:junit4]   2> 9675 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[84 (1417861228438487040)]} 0 1
[junit4:junit4]   2> 9676 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10089 (1417861228440584192)]} 0 0
[junit4:junit4]   2> 9698 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9698 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[84 (1417861228442681344)]} 0 20
[junit4:junit4]   2> 9701 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[84 (-1417861228466798592)]} 0 0
[junit4:junit4]   2> 9703 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9703 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10089 (1417861228461555712)]} 0 7
[junit4:junit4]   2> 9707 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9709 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[10090 (1417861228474138624)]} 0 1
[junit4:junit4]   2> 9710 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[84 (-1417861228469944320)]} 0 6
[junit4:junit4]   2> 9713 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[85 (1417861228478332928)]} 0 1
[junit4:junit4]   2> 9719 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9721 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[85 (1417861228482527232)]} 0 5
[junit4:junit4]   2> 9722 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4]   2> 9723 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10090 (1417861228481478656)]} 0 8
[junit4:junit4]   2> 9729 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[86 (1417861228495110144)]} 0 1
[junit4:junit4]   2> 9730 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[10091 (1417861228497207296)]} 0 0
[junit4:junit4]   2> 9735 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9738 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10091 (1417861228500353024)]} 0 5
[junit4:junit4]   2> 9740 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4]   2> 9741 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[86 (1417861228499304448)]} 0 9
[junit4:junit4]   2> 9742 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10092 (1417861228509790208)]} 0 0
[junit4:junit4]   2> 9744 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[87 (1417861228510838784)]} 0 1
[junit4:junit4]   2> 9750 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9750 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9750 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10092 (1417861228513984513)]} 0 4
[junit4:junit4]   2> 9750 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[87 (1417861228513984512)]} 0 4
[junit4:junit4]   2> 9753 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[86 (-1417861228521324544)]} 0 0
[junit4:junit4]   2> 9753 T1762 C142 P56404 /update {wt=javabin&version=2} {delete=[10088 (-1417861228521324545)]} 0 0
[junit4:junit4]   2> 9758 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9759 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[10088 (-1417861228524470272)]} 0 3
[junit4:junit4]   2> 9759 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9760 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[86 (-1417861228524470273)]} 0 4
[junit4:junit4]   2> 9763 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[88 (1417861228530761729)]} 0 1
[junit4:junit4]   2> 9766 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[10093 (1417861228530761728)]} 0 4
[junit4:junit4]   2> 9767 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9768 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[88 (1417861228533907456)]} 0 3
[junit4:junit4]   2> 9771 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9771 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10093 (1417861228536004608)]} 0 4
[junit4:junit4]   2> 9772 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[89 (1417861228541247488)]} 0 1
[junit4:junit4]   2> 9774 T1766 C142 P56404 /update {wt=javabin&version=2} {delete=[10089 (-1417861228543344640)]} 0 0
[junit4:junit4]   2> 9779 T1789 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9779 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[89 (1417861228544393216)]} 0 4
[junit4:junit4]   2> 9780 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9781 T1777 C141 P56413 /update {wt=javabin&version=2} {delete=[10089 (-1417861228546490368)]} 0 4
[junit4:junit4]   2> 9783 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[90 (1417861228551733248)]} 0 1
[junit4:junit4]   2> 9784 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10094 (1417861228552781824)]} 0 1
[junit4:junit4]   2> 9800 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9802 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9803 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[10094 (1417861228558024704)]} 0 15
[junit4:junit4]   2> 9804 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[90 (1417861228555927552)]} 0 18
[junit4:junit4]   2> 9806 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[10091 (-1417861228576899072)]} 0 0
[junit4:junit4]   2> 9811 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9812 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[91 (1417861228583190528)]} 0 0
[junit4:junit4]   2> 9814 T1778 C141 P56413 /update {wt=javabin&version=2} {delete=[10091 (-1417861228578996224)]} 0 6
[junit4:junit4]   2> 9816 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10095 (1417861228587384832)]} 0 0
[junit4:junit4]   2> 9819 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9821 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9822 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[10095 (1417861228589481984)]} 0 4
[junit4:junit4]   2> 9823 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[91 (1417861228588433408)]} 0 6
[junit4:junit4]   2> 9827 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10096 (1417861228598919168)]} 0 2
[junit4:junit4]   2> 9829 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[92 (1417861228601016320)]} 0 3
[junit4:junit4]   2> 9836 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4]   2> 9836 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9836 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[92 (1417861228604162048)]} 0 4
[junit4:junit4]   2> 9836 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10096 (1417861228602064896)]} 0 6
[junit4:junit4]   2> 9839 T1761 C142 P56404 /update {wt=javabin&version=2} {delete=[88 (-1417861228611502080)]} 0 0
[junit4:junit4]   2> 9839 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10097 (1417861228611502081)]} 0 0
[junit4:junit4]   2> 9850 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9851 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9851 T1782 C141 P56413 /update {wt=javabin&version=2} {delete=[88 (-1417861228619890688)]} 0 10
[junit4:junit4]   2> 9851 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10097 (1417861228619890689)]} 0 10
[junit4:junit4]   2> 9855 T1764 C142 P56404 /update {wt=javabin&version=2} {add=[93 (1417861228626182144)]} 0 2
[junit4:junit4]   2> 9856 T1765 C142 P56404 /update {wt=javabin&version=2} {add=[10098 (1417861228627230720)]} 0 2
[junit4:junit4]   2> 9861 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9862 T1779 C141 P56413 /update {wt=javabin&version=2} {add=[93 (1417861228631425024)]} 0 4
[junit4:junit4]   2> 9863 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9864 T1780 C141 P56413 /update {wt=javabin&version=2} {add=[10098 (1417861228632473600)]} 0 5
[junit4:junit4]   2> 9865 T1763 C142 P56404 /update {wt=javabin&version=2} {delete=[89 (-1417861228638765056)]} 0 0
[junit4:junit4]   2> 9866 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10099 (1417861228639813632)]} 0 0
[junit4:junit4]   2> 9870 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9871 T1781 C141 P56413 /update {wt=javabin&version=2} {delete=[89 (-1417861228640862208)]} 0 4
[junit4:junit4]   2> 9871 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9872 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10099 (1417861228641910784)]} 0 4
[junit4:junit4]   2> 9874 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[94 (1417861228647153664)]} 0 1
[junit4:junit4]   2> 9876 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10100 (1417861228649250816)]} 0 1
[junit4:junit4]   2> 9880 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9881 T1782 C141 P56413 /update {wt=javabin&version=2} {add=[94 (1417861228651347968)]} 0 4
[junit4:junit4]   2> 9881 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9882 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10100 (1417861228652396544)]} 0 4
[junit4:junit4]   2> 9883 T1764 C142 P56404 /update {wt=javabin&version=2} {delete=[91 (-1417861228657639424)]} 0 0
[junit4:junit4]   2> 9884 T1765 C142 P56404 /update {wt=javabin&version=2} {delete=[10095 (-1417861228658688000)]} 0 0
[junit4:junit4]   2> 9888 T1791 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9888 T1779 C141 P56413 /update {wt=javabin&version=2} {delete=[91 (-1417861228660785152)]} 0 2
[junit4:junit4]   2> 9890 T1794 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9890 T1780 C141 P56413 /update {wt=javabin&version=2} {delete=[10095 (-1417861228661833728)]} 0 3
[junit4:junit4]   2> 9891 T1763 C142 P56404 /update {wt=javabin&version=2} {add=[95 (1417861228666028032)]} 0 0
[junit4:junit4]   2> 9892 T1766 C142 P56404 /update {wt=javabin&version=2} {add=[10101 (1417861228667076608)]} 0 0
[junit4:junit4]   2> 9898 T1790 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9898 T1781 C141 P56413 /update {wt=javabin&version=2} {add=[95 (1417861228669173760)]} 0 4
[junit4:junit4]   2> 9901 T1761 C142 P56404 /update {wt=javabin&version=2} {add=[96 (1417861228676513792)]} 0 0
[junit4:junit4]   2> 9902 T1792 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4]   2> 9905 T1777 C141 P56413 /update {wt=javabin&version=2} {add=[10101 (1417861228671270912)]} 0 9
[junit4:junit4]   2> 9907 T1762 C142 P56404 /update {wt=javabin&version=2} {add=[10102 (1417861228682805248)]} 0 0
[junit4:junit4]   2> 9915 T1793 C140 P56419 REQ /update {distrib.from=http://127.0.0.1:56413/solr/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4]   2> 9915 T1778 C141 P56413 /update {wt=javabin&version=2} {add=[10102 (1417861228686999552)]} 0 4
[junit4:junit4]   2>

[...truncated too long message...]

er.java:553)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:526)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.<init>(Overseer.java:67)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer.start(Overseer.java:498)
[junit4:junit4]   2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:396)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:155)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:643)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:279)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:276)
[junit4:junit4]   2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:276)
[junit4:junit4]   2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:544)
[junit4:junit4]   2> ... 10 more
[junit4:junit4]   2>
[junit4:junit4]   2> 22910 T1784 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 22911 T1748 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 22912 T1840 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 22912 T1840 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 22912 T1784 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 22912 T1748 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 56404
[junit4:junit4]   2> 22912 T1840 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 22914 T1840 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 23074 T1748 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4]   2> 23076 T1748 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {range_facet_l=PostingsFormat(name=Memory doPackFST= true), text=Pulsing41(freqCutoff=18 minBlockSize=73 maxBlockSize=235), _version_=PostingsFormat(name=Memory doPackFST= true), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=Memory doPackFST= true), range_facet_sl=Pulsing41(freqCutoff=18 minBlockSize=73 maxBlockSize=235), range_facet_si=PostingsFormat(name=NestedPulsing), other_tl1=PostingsFormat(name=Memory doPackFST= true), multiDefault=PostingsFormat(name=NestedPulsing), a_si=PostingsFormat(name=NestedPulsing)}, sim=DefaultSimilarity, locale=sk_SK, timezone=IET
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=2,threads=1,free=129152976,total=213344256
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SolrCmdDistributorTest, StandardRequestHandlerTest, DistributedQueryElevationComponentTest, TestFastOutputStream, TestSurroundQueryParser, RequestHandlersTest, PeerSyncTest, AnalysisAfterCoreReloadTest, TestStressVersions, IndexSchemaRuntimeFieldTest, LegacyHTMLStripCharFilterTest, TestStressReorder, TestPHPSerializedResponseWriter, SpellCheckComponentTest, TestLFUCache, TestPropInjectDefaults, TestBinaryField, AutoCommitTest, TestUtils, TestLMDirichletSimilarityFactory, TestReversedWildcardFilterFactory, BadComponentTest, TestQuerySenderListener, PingRequestHandlerTest, TestJmxIntegration, TestUpdate, TestDocumentBuilder, CurrencyFieldTest, TestSolrJ, HighlighterConfigTest, TestRangeQuery, SearchHandlerTest, SpellPossibilityIteratorTest, TestCharFilters, FieldMutatingUpdateProcessorTest, QueryEqualityTest, SoftAutoCommitTest, TestSolrQueryParser, TestSolrIndexConfig, UpdateRequestProcessorFactoryTest, LeaderElectionIntegrationTest, JSONWriterTest, RequiredFieldsTest, TestMultiCoreConfBootstrap, TestSystemIdResolver, DirectUpdateHandlerTest, BasicDistributedZkTest, TestFastLRUCache, TestReplicationHandler, DebugComponentTest, SuggesterWFSTTest, SyncSliceTest, PathHierarchyTokenizerFactoryTest, TestFiltering, PrimUtilsTest, XmlUpdateRequestHandlerTest, TestSort, DistributedSpellCheckComponentTest, TestLazyCores, TestSolr4Spatial, LeaderElectionTest, OutputWriterTest, ZkCLITest, TestStressRecovery, FileBasedSpellCheckerTest, PreAnalyzedFieldTest, TestFaceting, RecoveryZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RecoveryZkTest -Dtests.seed=194DFF4D8F070D9B -Dtests.slow=true -Dtests.locale=sk_SK -Dtests.timezone=IET -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   0.00s | RecoveryZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope SUITE failed to close. Resource was registered from thread Thread[id=1798, name=RecoveryThread, state=RUNNABLE, group=TGRP-RecoveryZkTest], registration stack trace below.
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([194DFF4D8F070D9B]:0)
[junit4:junit4]    > at java.lang.Thread.getStackTrace(Thread.java:1479)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:150)
[junit4:junit4]    > at org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:514)
[junit4:junit4]    > at org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:958)
[junit4:junit4]    > at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:872)
[junit4:junit4]    > at org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:864)
[junit4:junit4]    > at org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:33)
[junit4:junit4]    > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:232)
[junit4:junit4]    > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:192)
[junit4:junit4]    > at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:373)
[junit4:junit4]    > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:273)
[junit4:junit4]    > at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:152)
[junit4:junit4]    > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:407)
[junit4:junit4]    > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:222)
[junit4:junit4]    > Caused by: java.lang.AssertionError: Directory not closed: MockDirWrapper(org.apache.lucene.store.RAMDirectory@70a4a9 lockFactory=org.apache.lucene.store.SimpleFSLockFactory@1922355)
[junit4:junit4]    > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > at org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:602)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:599)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:167)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:615)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
[junit4:junit4]    > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > at java.lang.Thread.run(Thread.java:662)
[junit4:junit4] Completed in 23.14s, 1 test, 1 error <<< FAILURES!

[...truncated 485 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 1 suite-level error, 12 ignored (7 assumptions)

Total time: 40 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_09) - Build # 1458 - Still Failing!

Policeman Jenkins Server
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1458/
Java: 32bit/jdk1.7.0_09 -server -XX:+UseG1GC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.TestSolrCoreProperties

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.TestSolrCoreProperties:     1) Thread[id=25, name=metrics-meter-tick-thread-2, state=WAITING, group=TGRP-TestSolrCoreProperties]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=24, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.TestSolrCoreProperties:
   1) Thread[id=25, name=metrics-meter-tick-thread-2, state=WAITING, group=TGRP-TestSolrCoreProperties]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
   2) Thread[id=24, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
        at __randomizedtesting.SeedInfo.seed([9782568F35F6C39C]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.TestSolrCoreProperties

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=25, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)    2) Thread[id=24, name=metrics-meter-tick-thread-1, state=WAITING, group=TGRP-TestSolrCoreProperties]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=25, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
   2) Thread[id=24, name=metrics-meter-tick-thread-1, state=WAITING, group=TGRP-TestSolrCoreProperties]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:722)
        at __randomizedtesting.SeedInfo.seed([9782568F35F6C39C]:0)




Build Log:
[...truncated 8378 lines...]
[junit4:junit4] Suite: org.apache.solr.TestSolrCoreProperties
[junit4:junit4]   2> -10 T12 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 220 T12 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:59941
[junit4:junit4]   2> 444 T12 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 445 T12 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.TestSolrCoreProperties-1352183273487
[junit4:junit4]   2> 446 T12 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '.\org.apache.solr.TestSolrCoreProperties-1352183273487\'
[junit4:junit4]   2> 901 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 903 T12 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 904 T12 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.TestSolrCoreProperties-1352183273487
[junit4:junit4]   2> 937 T12 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\solr.xml
[junit4:junit4]   2> 941 T12 oasc.CoreContainer.<init> New CoreContainer 30073354
[junit4:junit4]   2> 942 T12 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
[junit4:junit4]   2> 943 T12 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '.\org.apache.solr.TestSolrCoreProperties-1352183273487\'
[junit4:junit4]   2> 944 T12 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.TestSolrCoreProperties-1352183273487\'
[junit4:junit4]   2> 1014 T12 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1257 T12 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1
[junit4:junit4]   2> 1262 T12 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\'
[junit4:junit4]   2> 1414 T12 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1690 T12 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1719 T12 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1730 T12 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1893 T12 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2052 T12 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\, dataDir=.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\
[junit4:junit4]   2> 2053 T12 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4]   2> 2069 T12 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2153 T12 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@fae43c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19e5c2a) assuming 'simple'
[junit4:junit4]   2> 2156 T12 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data forceNew:false
[junit4:junit4]   2> 2157 T12 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data
[junit4:junit4]   2> 2157 T12 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\index/
[junit4:junit4]   2> 2159 T12 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2172 T12 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\index forceNew:false
[junit4:junit4]   2> 2481 T12 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@718f92 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@188bc85),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2482 T12 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2483 T12 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\index
[junit4:junit4]   2> 3194 T12 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3196 T12 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3196 T12 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3199 T12 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3226 T12 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3309 T12 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3335 T12 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data
[junit4:junit4]   2> 3367 T12 oass.SolrIndexSearcher.<init> Opening Searcher@19656b7 main
[junit4:junit4]   2> 3423 T12 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3424 T12 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3495 T12 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 3496 T12 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3496 T12 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 3496 T12 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3497 T12 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3498 T12 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3498 T12 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3499 T12 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3499 T12 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3521 T12 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 4071 T12 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4071 T26 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@19656b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4071 T12 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 4072 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4121 T12 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@13a031
[junit4:junit4]   2> 5156 T17 C0 REQ [collection1] webapp=/solr path=/select params={wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=279
[junit4:junit4]   2> 5313 T12 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=30073354
[junit4:junit4]   2> 5314 T12 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@13a031
[junit4:junit4]   2> 5314 T12 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 5315 T12 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 5315 T12 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 5316 T12 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 5321 T12 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 5321 T12 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.TestSolrCoreProperties-1352183273487\collection1\data\index
[junit4:junit4]   2> 5339 T12 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4]   2> 5604 T11 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 25884 T11 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 2 threads leaked from SUITE scope at org.apache.solr.TestSolrCoreProperties:
[junit4:junit4]   2>   1) Thread[id=25, name=metrics-meter-tick-thread-2, state=WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>   2) Thread[id=24, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 25885 T11 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2>   1) Thread[id=25, name=metrics-meter-tick-thread-2, state=WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2>   2) Thread[id=24, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2> 29448 T11 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4]   2>   1) Thread[id=25, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2>   2) Thread[id=24, name=metrics-meter-tick-thread-1, state=WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {}, sim=DefaultSimilarity, locale=es_EC, timezone=America/Miquelon
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_09 (32-bit)/cpus=2,threads=3,free=18340968,total=33554432
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSolrCoreProperties]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCoreProperties -Dtests.seed=9782568F35F6C39C -Dtests.slow=true -Dtests.locale=es_EC -Dtests.timezone=America/Miquelon -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s | TestSolrCoreProperties (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.TestSolrCoreProperties:
[junit4:junit4]    >    1) Thread[id=25, name=metrics-meter-tick-thread-2, state=WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    >    2) Thread[id=24, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([9782568F35F6C39C]:0)
[junit4:junit4]    > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=25, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    >    2) Thread[id=24, name=metrics-meter-tick-thread-1, state=WAITING, group=TGRP-TestSolrCoreProperties]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([9782568F35F6C39C]:0)
[junit4:junit4] Completed in 30.74s, 1 test, 2 errors <<< FAILURES!

[...truncated 705 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 2 suite-level errors, 881 ignored

Total time: 20 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_09 -server -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.6.0_37) - Build # 1459 - Still Failing!

Policeman Jenkins Server
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1459/
Java: 32bit/jdk1.6.0_37 -client -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestBinaryField

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:     1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:662)
   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:662)
        at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestBinaryField

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:662)
   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:662)
        at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)




Build Log:
[...truncated 7719 lines...]
[junit4:junit4] Suite: org.apache.solr.schema.TestBinaryField
[junit4:junit4]   2> -31 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/collection1\'
[junit4:junit4]   2> 825 T11 oejs.Server.doStart jetty-8.1.2.v20120308
[junit4:junit4]   2> 1077 T11 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:62057
[junit4:junit4]   2> 1186 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1187 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example
[junit4:junit4]   2> 1187 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
[junit4:junit4]   2> 1346 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1351 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1353 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example
[junit4:junit4]   2> 1391 T11 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\solr.xml
[junit4:junit4]   2> 1396 T11 oasc.CoreContainer.<init> New CoreContainer 400594
[junit4:junit4]   2> 1399 T11 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
[junit4:junit4]   2> 1400 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
[junit4:junit4]   2> 1401 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
[junit4:junit4]   2> 1460 T11 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1741 T11 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1
[junit4:junit4]   2> 1744 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\'
[junit4:junit4]   2> 1878 T11 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2181 T11 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2218 T11 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2232 T11 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2855 T11 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2999 T11 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\
[junit4:junit4]   2> 3000 T11 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4:junit4]   2> 3019 T11 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3111 T11 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@39da8a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3acc67) assuming 'simple'
[junit4:junit4]   2> 3114 T11 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data forceNew:false
[junit4:junit4]   2> 3114 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
[junit4:junit4]   2> 3115 T11 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index/
[junit4:junit4]   2> 3116 T11 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3139 T11 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index forceNew:false
[junit4:junit4]   2> 3503 T11 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3503 T11 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3504 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
[junit4:junit4]   2> 4323 T11 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4324 T11 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4325 T11 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4328 T11 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4358 T11 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4412 T11 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4517 T11 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4547 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
[junit4:junit4]   2> 4598 T11 oass.SolrIndexSearcher.<init> Opening Searcher@1e3cc77 main
[junit4:junit4]   2> 4675 T11 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4675 T11 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4772 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 4772 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4774 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4774 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4775 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4775 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4808 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 5279 T11 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 5280 T11 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5280 T25 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e3cc77 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5280 T11 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 5282 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 5334 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@956254
[junit4:junit4]   2> 6760 T17 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
[junit4:junit4]   2> 6767 T17 C0 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6768 T17 C0 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7165 T17 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[1]} 0 681
[junit4:junit4]   2> 7362 T16 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[2]} 0 1
[junit4:junit4]   2> 7367 T20 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[3]} 0 1
[junit4:junit4]   2> 7404 T19 C0 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 7953 T19 C0 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.doc, _0.tip, _0.fdt]
[junit4:junit4]   2> 7954 T19 C0 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.doc, _0.tip, _0.fdt]
[junit4:junit4]   2> 7956 T19 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
[junit4:junit4]   2> 8093 T19 C0 oass.SolrIndexSearcher.<init> Opening Searcher@13f212a main
[junit4:junit4]   2> 8100 T19 C0 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 8108 T25 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13f212a main{StandardDirectoryReader(segments_2:3 _0(5.0):C3)}
[junit4:junit4]   2> 8109 T25 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
[junit4:junit4]   2> 8109 T19 C0 UPDATE [collection1] webapp=/example path=/update params={waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 711
[junit4:junit4]   2> 8460 T15 C0 REQ [collection1] webapp=/example path=/select params={wt=javabin&q=*:*&version=2} hits=3 status=0 QTime=322
[junit4:junit4]   2> 8534 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=400594
[junit4:junit4]   2> 8535 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@956254
[junit4:junit4]   2> 8535 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 8537 T11 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 8537 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 8537 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 8539 T11 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
[junit4:junit4]   2> 8540 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 8542 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
[junit4:junit4]   2> 8547 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/example,null}
[junit4:junit4]   2> 8849 T10 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 28908 T10 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
[junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> 28909 T10 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2> 32189 T10 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=hu, timezone=Indian/Mayotte
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=2,threads=3,free=54791880,total=65470464
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestBinaryField]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBinaryField -Dtests.seed=28100922E87E2C5D -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Indian/Mayotte -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   0.00s | TestBinaryField (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
[junit4:junit4]    >    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]    >    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
[junit4:junit4]    > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]    >    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
[junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
[junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
[junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
[junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
[junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
[junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
[junit4:junit4] Completed in 33.57s, 1 test, 2 errors <<< FAILURES!

[...truncated 705 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 2 suite-level errors, 881 ignored

Total time: 19 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.6.0_37 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure




---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

Re: [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.6.0_37) - Build # 1459 - Still Failing!

Alan Woodward
I committed a fix

On 6 Nov 2012, at 07:28, Policeman Jenkins Server wrote:

> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1459/
> Java: 32bit/jdk1.6.0_37 -client -XX:+UseConcMarkSweepGC
>
> 2 tests failed.
> FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestBinaryField
>
> Error Message:
> 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:     1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>        at java.lang.Thread.run(Thread.java:662)
>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>        at java.lang.Thread.run(Thread.java:662)
> at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestBinaryField
>
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)         at java.lang.Thread.run(Thread.java:662)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>        at java.lang.Thread.run(Thread.java:662)
>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>        at java.lang.Thread.run(Thread.java:662)
> at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
>
>
>
>
> Build Log:
> [...truncated 7719 lines...]
> [junit4:junit4] Suite: org.apache.solr.schema.TestBinaryField
> [junit4:junit4]   2> -31 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/collection1\'
> [junit4:junit4]   2> 825 T11 oejs.Server.doStart jetty-8.1.2.v20120308
> [junit4:junit4]   2> 1077 T11 oejs.AbstractConnector.doStart Started SelectChannelConnector@0.0.0.0:62057
> [junit4:junit4]   2> 1186 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 1187 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example
> [junit4:junit4]   2> 1187 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
> [junit4:junit4]   2> 1346 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
> [junit4:junit4]   2> 1351 T11 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 1353 T11 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example
> [junit4:junit4]   2> 1391 T11 oasc.CoreContainer$Initializer.initialize looking for solr.xml: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\solr.xml
> [junit4:junit4]   2> 1396 T11 oasc.CoreContainer.<init> New CoreContainer 400594
> [junit4:junit4]   2> 1399 T11 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
> [junit4:junit4]   2> 1400 T11 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
> [junit4:junit4]   2> 1401 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\'
> [junit4:junit4]   2> 1460 T11 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 1741 T11 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1
> [junit4:junit4]   2> 1744 T11 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\'
> [junit4:junit4]   2> 1878 T11 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
> [junit4:junit4]   2> 2181 T11 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
> [junit4:junit4]   2> 2218 T11 oass.IndexSchema.readSchema Reading Solr Schema
> [junit4:junit4]   2> 2232 T11 oass.IndexSchema.readSchema Schema name=test
> [junit4:junit4]   2> 2855 T11 oass.IndexSchema.readSchema unique key field: id
> [junit4:junit4]   2> 2999 T11 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\
> [junit4:junit4]   2> 3000 T11 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
> [junit4:junit4]   2> 3019 T11 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 3111 T11 oasc.CachingDirectoryFactory.injectLockFactory WARNING No lockType configured for MockDirWrapper(org.apache.lucene.store.RAMDirectory@39da8a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3acc67) assuming 'simple'
> [junit4:junit4]   2> 3114 T11 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data forceNew:false
> [junit4:junit4]   2> 3114 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
> [junit4:junit4]   2> 3115 T11 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index/
> [junit4:junit4]   2> 3116 T11 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index' doesn't exist. Creating new index...
> [junit4:junit4]   2> 3139 T11 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index forceNew:false
> [junit4:junit4]   2> 3503 T11 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 3503 T11 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 3504 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
> [junit4:junit4]   2> 4323 T11 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 4324 T11 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 4325 T11 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 4328 T11 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 4358 T11 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 4412 T11 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 4517 T11 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 4547 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
> [junit4:junit4]   2> 4598 T11 oass.SolrIndexSearcher.<init> Opening Searcher@1e3cc77 main
> [junit4:junit4]   2> 4675 T11 oasu.CommitTracker.<init> Hard AutoCommit: disabled
> [junit4:junit4]   2> 4675 T11 oasu.CommitTracker.<init> Soft AutoCommit: disabled
> [junit4:junit4]   2> 4772 T11 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> [junit4:junit4]   2> 4772 T11 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
> [junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> [junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 4773 T11 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> [junit4:junit4]   2> 4774 T11 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 4774 T11 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 4775 T11 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 4775 T11 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> [junit4:junit4]   2> 4808 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
> [junit4:junit4]   2> 5279 T11 oash.ReplicationHandler.inform Commits will be reserved for  10000
> [junit4:junit4]   2> 5280 T11 oasc.CoreContainer.registerCore registering core: collection1
> [junit4:junit4]   2> 5280 T25 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e3cc77 main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 5280 T11 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
> [junit4:junit4]   2> 5282 T11 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
> [junit4:junit4]   2> 5334 T11 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
> [junit4:junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@956254
> [junit4:junit4]   2> 6760 T17 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
> [junit4:junit4]   2> 6767 T17 C0 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
> [junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 6768 T17 C0 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
> [junit4:junit4]   2> 7165 T17 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[1]} 0 681
> [junit4:junit4]   2> 7362 T16 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[2]} 0 1
> [junit4:junit4]   2> 7367 T20 C0 UPDATE [collection1] webapp=/example path=/update params={wt=javabin&version=2} {add=[3]} 0 1
> [junit4:junit4]   2> 7404 T19 C0 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
> [junit4:junit4]   2> 7953 T19 C0 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
> [junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@145f5e3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@170984c),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.doc, _0.tip, _0.fdt]
> [junit4:junit4]   2> 7954 T19 C0 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0.tim, _0_nrm.cfe, segments_2, _0.fdx, _0_nrm.cfs, _0.si, _0.doc, _0.tip, _0.fdt]
> [junit4:junit4]   2> 7956 T19 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data
> [junit4:junit4]   2> 8093 T19 C0 oass.SolrIndexSearcher.<init> Opening Searcher@13f212a main
> [junit4:junit4]   2> 8100 T19 C0 oasu.DirectUpdateHandler2.commit end_commit_flush
> [junit4:junit4]   2> 8108 T25 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13f212a main{StandardDirectoryReader(segments_2:3 _0(5.0):C3)}
> [junit4:junit4]   2> 8109 T25 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
> [junit4:junit4]   2> 8109 T19 C0 UPDATE [collection1] webapp=/example path=/update params={waitSearcher=true&wt=javabin&commit=true&softCommit=false&version=2} {commit=} 0 711
> [junit4:junit4]   2> 8460 T15 C0 REQ [collection1] webapp=/example path=/select params={wt=javabin&q=*:*&version=2} hits=3 status=0 QTime=322
> [junit4:junit4]   2> 8534 T11 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=400594
> [junit4:junit4]   2> 8535 T11 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@956254
> [junit4:junit4]   2> 8535 T11 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 8537 T11 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
> [junit4:junit4]   2> 8537 T11 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 8537 T11 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 8539 T11 C0 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
> [junit4:junit4]   2> 8540 T11 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
> [junit4:junit4]   2> 8542 T11 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBinaryField-1352186835411\example\collection1\data\index
> [junit4:junit4]   2> 8547 T11 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/example,null}
> [junit4:junit4]   2> 8849 T10 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
> [junit4:junit4]   2> 28908 T10 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
> [junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> 28909 T10 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
> [junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2> 32189 T10 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
> [junit4:junit4]   2>   1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2>   2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]   2>        at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]   2>        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]   2>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]   2>        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]   2>        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]   2>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]   2>        at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=hu, timezone=Indian/Mayotte
> [junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_37 (32-bit)/cpus=2,threads=3,free=54791880,total=65470464
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [TestBinaryField]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBinaryField -Dtests.seed=28100922E87E2C5D -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Indian/Mayotte -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] ERROR   0.00s | TestBinaryField (suite) <<<
> [junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.schema.TestBinaryField:
> [junit4:junit4]    >    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]    >    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
> [junit4:junit4]    > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
> [junit4:junit4]    >    1) Thread[id=24, name=metrics-meter-tick-thread-2, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]    >    2) Thread[id=23, name=metrics-meter-tick-thread-1, state=TIMED_WAITING, group=TGRP-TestBinaryField]
> [junit4:junit4]    >         at sun.misc.Unsafe.park(Native Method)
> [junit4:junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:196)
> [junit4:junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2025)
> [junit4:junit4]    >         at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
> [junit4:junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> [junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> [junit4:junit4]    >         at java.lang.Thread.run(Thread.java:662)
> [junit4:junit4]    > at __randomizedtesting.SeedInfo.seed([28100922E87E2C5D]:0)
> [junit4:junit4] Completed in 33.57s, 1 test, 2 errors <<< FAILURES!
>
> [...truncated 705 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 2 suite-level errors, 881 ignored
>
> Total time: 19 minutes 42 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 32bit/jdk1.6.0_37 -client -XX:+UseConcMarkSweepGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]