Solr 6.3 will not stay connected to zookeeper

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Solr 6.3 will not stay connected to zookeeper

Walter Underwood
Python kazoo can talk to zookeeper, uploading these same files. Solr fails. What is going on?

$ bin/solr create -c tutors -d tutors

Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
Uploading /apps/solr6/server/solr/configsets/tutors/conf for config tutors to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud
WARN  - 2017-03-15 16:24:58.385; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-15 16:24:58.387; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-15 16:25:05.489; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-15 16:25:05.490; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected

ERROR: Error uploading file /apps/solr6/server/solr/configsets/tutors/conf/schema.xml to zookeeper path /configs/tutors/schema.xml


wunder
Walter Underwood
[hidden email]
http://observer.wunderwood.org/  (my blog)


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr 6.3 will not stay connected to zookeeper

Walter Underwood
This happens with the data_directed_schema_configs example, too.

Could it be a file size issue? Small files are succeeding.

For the data_driven example, stopwords_it.txt (4924 bytes) worked, but stoptags_ja.txt (16724 bytes) failed. For my tutors config, schema.xml (9974 bytes) failed. The largest file uploaded was 1094 bytes.

wunder
Walter Underwood
[hidden email]
http://observer.wunderwood.org/  (my blog)


> On Mar 15, 2017, at 4:27 PM, Walter Underwood <[hidden email]> wrote:
>
> Python kazoo can talk to zookeeper, uploading these same files. Solr fails. What is going on?
>
> $ bin/solr create -c tutors -d tutors
>
> Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
> Uploading /apps/solr6/server/solr/configsets/tutors/conf for config tutors to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud
> WARN  - 2017-03-15 16:24:58.385; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN  - 2017-03-15 16:24:58.387; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> WARN  - 2017-03-15 16:25:05.489; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN  - 2017-03-15 16:25:05.490; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>
> ERROR: Error uploading file /apps/solr6/server/solr/configsets/tutors/conf/schema.xml to zookeeper path /configs/tutors/schema.xml
>
>
> wunder
> Walter Underwood
> [hidden email]
> http://observer.wunderwood.org/  (my blog)
>
>

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr 6.3 will not stay connected to zookeeper

Walter Underwood
I have a pretty good guess what happened. I requested a Zookeeper 3.4.6 cluster, but they built a 3.4.9 cluster.

wunder
Walter Underwood
[hidden email]
http://observer.wunderwood.org/  (my blog)


> On Mar 15, 2017, at 4:38 PM, Walter Underwood <[hidden email]> wrote:
>
> This happens with the data_directed_schema_configs example, too.
>
> Could it be a file size issue? Small files are succeeding.
>
> For the data_driven example, stopwords_it.txt (4924 bytes) worked, but stoptags_ja.txt (16724 bytes) failed. For my tutors config, schema.xml (9974 bytes) failed. The largest file uploaded was 1094 bytes.
>
> wunder
> Walter Underwood
> [hidden email]
> http://observer.wunderwood.org/  (my blog)
>
>
>> On Mar 15, 2017, at 4:27 PM, Walter Underwood <[hidden email]> wrote:
>>
>> Python kazoo can talk to zookeeper, uploading these same files. Solr fails. What is going on?
>>
>> $ bin/solr create -c tutors -d tutors
>>
>> Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
>> Uploading /apps/solr6/server/solr/configsets/tutors/conf for config tutors to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud
>> WARN  - 2017-03-15 16:24:58.385; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>> WARN  - 2017-03-15 16:24:58.387; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>> WARN  - 2017-03-15 16:25:05.489; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>> WARN  - 2017-03-15 16:25:05.490; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>
>> ERROR: Error uploading file /apps/solr6/server/solr/configsets/tutors/conf/schema.xml to zookeeper path /configs/tutors/schema.xml
>>
>>
>> wunder
>> Walter Underwood
>> [hidden email]
>> http://observer.wunderwood.org/  (my blog)
>>
>>
>

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr 6.3 will not stay connected to zookeeper

Walter Underwood
Still broken with zk 3.4.6. Even the “solr zk” commands can’t fetch the file. It is there. I can list it.

$ bin/solr zk ls /configs/tutors

Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
Getting listing for Zookeeper node /configs/tutors from ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud recurse: false
enumsConfig.xml
solrconfig.xml
admin-extra.menu-top.html
tutors-subject-names.txt
schema.xml
velocity
xslt
admin-extra.html
admin-extra.menu-bottom.html
$ bin/solr zk cp zk:/configs/tutors/solrconfig.xml .

Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
Copying from 'zk:/configs/tutors/solrconfig.xml' to '.'. ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud
WARN  - 2017-03-16 11:27:39.418; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:27:39.420; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:28:00.040; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:28:00.040; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:28:20.620; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:28:20.620; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:28:41.366; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:28:41.366; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:29:01.485; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:29:01.486; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:29:22.316; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:29:22.317; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
WARN  - 2017-03-16 11:29:42.912; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1a74e9d1 name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:29:42.913; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
 ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
WARN  - 2017-03-16 11:30:13.327; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
ERROR - 2017-03-16 11:30:14.033; org.apache.solr.util.SolrCLI$ZkCpTool; Could not complete the zk operation for reason: KeeperErrorCode = ConnectionLoss for /configs/tutors/solrconfig.xml

ERROR: KeeperErrorCode = ConnectionLoss for /configs/tutors/solrconfig.xml


wunder
Walter Underwood
[hidden email]
http://observer.wunderwood.org/  (my blog)


> On Mar 15, 2017, at 5:45 PM, Walter Underwood <[hidden email]> wrote:
>
> I have a pretty good guess what happened. I requested a Zookeeper 3.4.6 cluster, but they built a 3.4.9 cluster.
>
> wunder
> Walter Underwood
> [hidden email] <mailto:[hidden email]>
> http://observer.wunderwood.org/  (my blog)
>
>
>> On Mar 15, 2017, at 4:38 PM, Walter Underwood <[hidden email] <mailto:[hidden email]>> wrote:
>>
>> This happens with the data_directed_schema_configs example, too.
>>
>> Could it be a file size issue? Small files are succeeding.
>>
>> For the data_driven example, stopwords_it.txt (4924 bytes) worked, but stoptags_ja.txt (16724 bytes) failed. For my tutors config, schema.xml (9974 bytes) failed. The largest file uploaded was 1094 bytes.
>>
>> wunder
>> Walter Underwood
>> [hidden email] <mailto:[hidden email]>
>> http://observer.wunderwood.org/  (my blog)
>>
>>
>>> On Mar 15, 2017, at 4:27 PM, Walter Underwood <[hidden email]> wrote:
>>>
>>> Python kazoo can talk to zookeeper, uploading these same files. Solr fails. What is going on?
>>>
>>> $ bin/solr create -c tutors -d tutors
>>>
>>> Connecting to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud ...
>>> Uploading /apps/solr6/server/solr/configsets/tutors/conf for config tutors to ZooKeeper at zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud
>>> WARN  - 2017-03-15 16:24:58.385; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>>> WARN  - 2017-03-15 16:24:58.387; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>> WARN  - 2017-03-15 16:25:05.489; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>>> WARN  - 2017-03-15 16:25:05.490; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>>> WARN  - 2017-03-15 16:25:12.354; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>>> WARN  - 2017-03-15 16:25:23.460; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@147a41e name: ZooKeeperConnection Watcher:zookeeper01.prod2.cloud.cheggnet.com:2181,zookeeper02.prod2.cloud.cheggnet.com:2181,zookeeper03.prod2.cloud.cheggnet.com,zookeeper04.prod2.cloud.cheggnet.com,zookeeper05.prod2.cloud.cheggnet.com:2181/solr-cloud got event WatchedEvent state:Disconnected type:None path:null path: null type: None
>>> WARN  - 2017-03-15 16:25:34.468; org.apache.solr.common.cloud.ConnectionManager; zkClient has disconnected
>>>
>>> ERROR: Error uploading file /apps/solr6/server/solr/configsets/tutors/conf/schema.xml to zookeeper path /configs/tutors/schema.xml
>>>
>>>
>>> wunder
>>> Walter Underwood
>>> [hidden email]
>>> http://observer.wunderwood.org/  (my blog)
>>>
>>>
>>
>

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Solr 6.3 will not stay connected to zookeeper

Shawn Heisey-2
In reply to this post by Walter Underwood
On 3/15/2017 6:45 PM, Walter Underwood wrote:
> I have a pretty good guess what happened. I requested a Zookeeper
> 3.4.6 cluster, but they built a 3.4.9 cluster.

This is the first I've heard of problems with ZK 3.4.9 on the server
side.  That would be the server version that I would recommend for a new
install -- the list of bugfixes on each 3.4.x ZK version is quite long.
Without checking each one I cannot say whether any of them would affect
SolrCloud, but I'd rather be running a version with the fixes.

The log messages read like it's not able to establish a TCP connection,
which is a fairly low level problem.  The problems I consider to be most
likely are a firewall or a security layer like selinux/apparmor.

I would not expect a ZK downgrade to make any difference, unless another
change is made along with the downgrade.

Thanks,
Shawn

Loading...