cannot download the config directory with zkcli.bat from embedded zookeeper

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

cannot download the config directory with zkcli.bat from embedded zookeeper

Arturas Mazeika
Hi Solr Folks,

I was benchmarking solrCloud with the German Wikipedia docs under Windows
10 Pro, noticed that Windows defender was grabbing resources substantially,
changed the policy (so windows defender would not kick in). Since then I am
not able to download the config files from the solrCloud with

f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat -zkhost
localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname
de_wiki_man


Caused by: java.io.IOException: Unable to establish loopback connection

(see [1] for more details)

What's going on? On a Linux VM the same commands fly with green colors.

Details:

An example cloud environment was created with

F:\solr_server\solr-7.3.1>bin\solr.cmd start -e cloud

(see [2] for more details)

Netstat on windows reports no problems [3].

I am able to connect to 10999 port with telnet and get the stats [4].

solrs can communicate with each other without problems [5].

zoo.cfg is the standart one [6].

I also tried the same with 7.2.1 and 7.4.0 (without any success and the
same error). Interestingly enough, there's an error in script files in
7.4.0 (no biggy) [7].

Cheers,
Arturas

References:

[1] F:\solr_server\solr-7.3.1>server\scripts\cloud-scripts\zkcli.bat
-zkhost localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config2
-confname de_wiki_man
Exception in thread "main" org.apache.solr.common.SolrException:
java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:171)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:120)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:110)
        at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197)
Caused by: java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1845)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:452)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:383)
        at
org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
        at
org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
        at
org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:149)
        ... 3 more
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
Source)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1843)
        ... 9 more
Caused by: java.io.IOException: Unable to establish loopback connection
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.nio.ch.PipeImpl.<init>(Unknown Source)
        at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source)
        at java.nio.channels.Pipe.open(Unknown Source)
        at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source)
        at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source)
        at java.nio.channels.Selector.open(Unknown Source)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
        ... 14 more
Caused by: java.net.ConnectException: Connection timed out: connect
        at sun.nio.ch.Net.connect0(Native Method)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
        at java.nio.channels.SocketChannel.open(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown
Source)


[2] F:\solr_server\solr-7.3.1>bin\solr.cmd start -e cloud

Welcome to the SolrCloud example!

This interactive session will help you launch a SolrCloud cluster on your
local workstation.
To begin, how many Solr nodes would you like to run in your local cluster?
(specify 1-4 nodes) [2]:
4
Ok, let's start up 4 Solr nodes for your example SolrCloud cluster.
Please enter the port for node1 [8983]:
9999
Please enter the port for node2 [7574]:
9998
Please enter the port for node3 [8984]:
9997
Please enter the port for node4 [7575]:
9996
Creating Solr home directory
F:\solr_server\solr-7.3.1\example\cloud\node1\solr
Cloning F:\solr_server\solr-7.3.1\example\cloud\node1 into
   F:\solr_server\solr-7.3.1\example\cloud\node2
Cloning F:\solr_server\solr-7.3.1\example\cloud\node1 into
   F:\solr_server\solr-7.3.1\example\cloud\node3
Cloning F:\solr_server\solr-7.3.1\example\cloud\node1 into
   F:\solr_server\solr-7.3.1\example\cloud\node4

Starting up Solr on port 9999 using command:
"F:\solr_server\solr-7.3.1\bin\solr.cmd" start -cloud -p 9999 -s
"F:\solr_server\solr-7.3.1\example\cloud\node1\solr"

Waiting up to 30 to see Solr running on port 9999
Started Solr server on port 9999. Happy searching!

Starting up Solr on port 9998 using command:
"F:\solr_server\solr-7.3.1\bin\solr.cmd" start -cloud -p 9998 -s
"F:\solr_server\solr-7.3.1\example\cloud\node2\solr" -z localhost:10999

Waiting up to 30 to see Solr running on port 9998
Started Solr server on port 9998. Happy searching!

Starting up Solr on port 9997 using command:
"F:\solr_server\solr-7.3.1\bin\solr.cmd" start -cloud -p 9997 -s
"F:\solr_server\solr-7.3.1\example\cloud\node3\solr" -z localhost:10999

Waiting up to 30 to see Solr running on port 9997
Started Solr server on port 9997. Happy searching!

Starting up Solr on port 9996 using command:
"F:\solr_server\solr-7.3.1\bin\solr.cmd" start -cloud -p 9996 -s
"F:\solr_server\solr-7.3.1\example\cloud\node4\solr" -z localhost:10999

Waiting up to 30 to see Solr running on port 9996
Started Solr server on port 9996. Happy searching!
INFO  - 2018-06-28 11:25:40.623;
org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at
localhost:10999 ready

Now let's create a new collection for indexing documents in your 4-node
cluster.
Please provide a name for your new collection: [gettingstarted]
de_wiki_man
How many shards would you like to split de_wiki_man into? [2]
4
How many replicas per shard would you like to create? [2]

Please choose a configuration for the de_wiki_man collection, available
options are:
_default or sample_techproducts_configs [_default]

Created collection 'de_wiki_man' with 4 shard(s), 2 replica(s) with
config-set 'de_wiki_man'

Enabling auto soft-commits with maxTime 3 secs using the Config API

POSTing request to Config API: http://localhost:9999/solr/de_wiki_man/config
{"set-property":{"updateHandler.autoSoftCommit.maxTime":"3000"}}
Successfully set-property updateHandler.autoSoftCommit.maxTime to 3000


SolrCloud example running, please visit: http://localhost:9999/solr


[3] C:\WINDOWS\system32>netstat -a -b  | grep 999
  TCP    0.0.0.0:9996           Arteika:0              LISTENING
  TCP    0.0.0.0:9997           Arteika:0              LISTENING
  TCP    0.0.0.0:9998           Arteika:0              LISTENING
  TCP    0.0.0.0:9999           Arteika:0              LISTENING
  TCP    0.0.0.0:10999          Arteika:0              LISTENING
  TCP    127.0.0.1:8999         Arteika:0              LISTENING
  TCP    127.0.0.1:10999        Arteika:54197          ESTABLISHED
  TCP    127.0.0.1:10999        Arteika:54253          ESTABLISHED
  TCP    127.0.0.1:10999        Arteika:54262          ESTABLISHED
  TCP    127.0.0.1:10999        Arteika:54294          ESTABLISHED
  TCP    127.0.0.1:54197        Arteika:10999          ESTABLISHED
  TCP    127.0.0.1:54242        Arteika:9998           TIME_WAIT
  TCP    127.0.0.1:54253        Arteika:10999          ESTABLISHED
  TCP    127.0.0.1:54262        Arteika:10999          ESTABLISHED
  TCP    127.0.0.1:54271        Arteika:9997           TIME_WAIT
  TCP    127.0.0.1:54272        Arteika:9997           TIME_WAIT
  TCP    127.0.0.1:54294        Arteika:10999          ESTABLISHED
  TCP    127.0.0.1:54303        Arteika:9996           TIME_WAIT
  TCP    127.0.0.1:54304        Arteika:9996           TIME_WAIT
  TCP    127.0.0.1:54310        Arteika:9999           TIME_WAIT
  TCP    127.0.0.1:54311        Arteika:9999           TIME_WAIT
  TCP    127.0.0.1:54314        Arteika:10999          TIME_WAIT
  TCP    127.0.0.1:54315        Arteika:9999           TIME_WAIT
  TCP    127.0.0.1:54316        Arteika:9999           TIME_WAIT
  TCP    127.0.0.1:54330        Arteika:9999           TIME_WAIT
  TCP    192.168.56.1:9996      Arteika:54320          ESTABLISHED
  TCP    192.168.56.1:9996      Arteika:54324          ESTABLISHED
  TCP    192.168.56.1:9996      Arteika:54326          ESTABLISHED
  TCP    192.168.56.1:9996      Arteika:54327          ESTABLISHED
  TCP    192.168.56.1:9997      Arteika:54322          ESTABLISHED
  TCP    192.168.56.1:9997      Arteika:54323          ESTABLISHED
  TCP    192.168.56.1:9997      Arteika:54328          ESTABLISHED
  TCP    192.168.56.1:9997      Arteika:54329          ESTABLISHED
  TCP    192.168.56.1:9998      Arteika:54318          ESTABLISHED
  TCP    192.168.56.1:9998      Arteika:54319          ESTABLISHED
  TCP    192.168.56.1:9999      Arteika:54317          ESTABLISHED
  TCP    192.168.56.1:9999      Arteika:54321          ESTABLISHED
  TCP    192.168.56.1:54317     Arteika:9999           ESTABLISHED
  TCP    192.168.56.1:54318     Arteika:9998           ESTABLISHED
  TCP    192.168.56.1:54319     Arteika:9998           ESTABLISHED
  TCP    192.168.56.1:54320     Arteika:9996           ESTABLISHED
  TCP    192.168.56.1:54321     Arteika:9999           ESTABLISHED
  TCP    192.168.56.1:54322     Arteika:9997           ESTABLISHED
  TCP    192.168.56.1:54323     Arteika:9997           ESTABLISHED
  TCP    192.168.56.1:54324     Arteika:9996           ESTABLISHED
  TCP    192.168.56.1:54326     Arteika:9996           ESTABLISHED
  TCP    192.168.56.1:54327     Arteika:9996           ESTABLISHED
  TCP    192.168.56.1:54328     Arteika:9997           ESTABLISHED
  TCP    192.168.56.1:54329     Arteika:9997           ESTABLISHED
  TCP    192.168.56.1:54331     Arteika:9997           TIME_WAIT
  TCP    192.168.56.1:54332     Arteika:9999           TIME_WAIT
  TCP    192.168.56.1:54333     Arteika:9996           TIME_WAIT
  TCP    192.168.56.1:54334     Arteika:9996           TIME_WAIT
  TCP    192.168.56.1:54335     Arteika:9998           TIME_WAIT
  TCP    192.168.56.1:54336     Arteika:9999           TIME_WAIT
  TCP    192.168.56.1:54337     Arteika:9998           TIME_WAIT
  TCP    192.168.56.1:54338     Arteika:9997           TIME_WAIT
  TCP    [::]:9996              Arteika:0              LISTENING
  TCP    [::]:9997              Arteika:0              LISTENING
  TCP    [::]:9998              Arteika:0              LISTENING
  TCP    [::]:9999              Arteika:0              LISTENING
  TCP    [::]:10999             Arteika:0              LISTENING
  TCP    [::1]:10999            Arteika:54200          ESTABLISHED
  TCP    [::1]:10999            Arteika:54225          ESTABLISHED
  TCP    [::1]:10999            Arteika:54232          ESTABLISHED
  TCP    [::1]:10999            Arteika:54285          ESTABLISHED
  TCP    [::1]:54200            Arteika:10999          ESTABLISHED
  TCP    [::1]:54225            Arteika:10999          ESTABLISHED
  TCP    [::1]:54232            Arteika:10999          ESTABLISHED
  TCP    [::1]:54285            Arteika:10999          ESTABLISHED
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54350  Arteika:9999
TIME_WAIT
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54351  Arteika:9999
TIME_WAIT
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54352  Arteika:9999
TIME_WAIT
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54353  Arteika:9999
TIME_WAIT
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54354  Arteika:9999
TIME_WAIT
  TCP    [fe80::b40b:85fe:cf77:ac82%3]:54355  Arteika:9999
TIME_WAIT



[4]     telnet localhost 10999
stat
Zookeeper version: 3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built
on 11/01/2017 18:06 GMT
Clients:
 /0:0:0:0:0:0:0:1:54225[1](queued=0,recved=1506,sent=1523)
 /127.0.0.1:54262[1](queued=0,recved=360,sent=362)
 /0:0:0:0:0:0:0:1:54200[1](queued=0,recved=471,sent=476)
 /127.0.0.1:54253[1](queued=0,recved=1453,sent=1467)
 /0:0:0:0:0:0:0:1:54285[1](queued=0,recved=1447,sent=1460)
 /0:0:0:0:0:0:0:1:54232[1](queued=0,recved=365,sent=368)
 /127.0.0.1:54197[1](queued=0,recved=2818,sent=2875)
 /127.0.0.1:54294[1](queued=0,recved=354,sent=355)
 /0:0:0:0:0:0:0:1:54490[0](queued=0,recved=1,sent=0)

Latency min/avg/max: 0/0/49
                           Received: 9071
                                         Sent: 9183
                                                   Connections: 9

Outstanding: 0

Zxid: 0x14f

Mode: standalone

Node count: 164


Connection to host lost.

[5] solr.log:
...
INFO  - 2018-06-28 09:24:38.734; [   ]
org.apache.solr.cloud.SolrZkServerProps; Reading configuration from:
F:\solr_server\solr-7.3.1\example\cloud\node1\solr\zoo.cfg
INFO  - 2018-06-28 09:24:38.735; [   ] org.apache.solr.cloud.SolrZkServer;
STARTING EMBEDDED STANDALONE ZOOKEEPER SERVER at port 10999
INFO  - 2018-06-28 09:24:39.236; [   ] org.apache.solr.core.ZkContainer;
Zookeeper client=localhost:10999
INFO  - 2018-06-28 09:24:43.796; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:24:44.071; [   ] org.apache.solr.cloud.Overseer;
Overseer (id=null) closing
INFO  - 2018-06-28 09:24:44.074; [   ]
org.apache.solr.cloud.OverseerElectionContext; I am going to be the leader
192.168.56.1:9999_solr
INFO  - 2018-06-28 09:24:44.078; [   ] org.apache.solr.cloud.Overseer;
Overseer (id=72061338520059904-192.168.56.1:9999_solr-n_0000000000) starting
INFO  - 2018-06-28 09:24:44.122; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:24:44.124; [   ]
org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at
localhost:10999 ready
INFO  - 2018-06-28 09:24:44.153; [   ] org.apache.solr.cloud.ZkController;
Register node as live in ZooKeeper:/live_nodes/192.168.56.1:9999_solr
INFO  - 2018-06-28 09:24:44.166; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (1)
INFO  - 2018-06-28 09:24:44.166; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (1)
INFO  - 2018-06-28 09:24:48.840; [   ]
org.apache.solr.core.CorePropertiesLocator; Found 0 core definitions
underneath F:\solr_server\solr-7.3.1\example\cloud\node1\solr
INFO  - 2018-06-28 09:24:49.013; [   ]
org.eclipse.jetty.server.handler.ContextHandler; Started
o.e.j.w.WebAppContext@436e852b
{/solr,file:///F:/solr_server/solr-7.3.1/server/solr-webapp/webapp/,AVAILABLE}{file:///F:/solr_server/solr-7.3.1/server//solr-webapp/webapp}
INFO  - 2018-06-28 09:24:49.022; [   ]
org.eclipse.jetty.server.AbstractConnector; Started ServerConnector@66c61024
{HTTP/1.1,[http/1.1]}{0.0.0.0:9999}
INFO  - 2018-06-28 09:24:49.022; [   ] org.eclipse.jetty.server.Server;
Started @11457ms
INFO  - 2018-06-28 09:24:49.301; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=69
INFO  - 2018-06-28 09:24:49.324; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:24:49.327; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=3
INFO  - 2018-06-28 09:24:50.612; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=26
INFO  - 2018-06-28 09:24:50.624; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:24:50.625; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=1
INFO  - 2018-06-28 09:24:58.946; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (1) -> (2)
INFO  - 2018-06-28 09:24:58.946; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (1) -> (2)
INFO  - 2018-06-28 09:25:14.050; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (2) -> (3)
INFO  - 2018-06-28 09:25:14.050; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (2) -> (3)
INFO  - 2018-06-28 09:25:29.137; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
INFO  - 2018-06-28 09:25:29.137; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
...



...
INFO  - 2018-06-28 09:24:53.961; [   ]
org.apache.solr.core.SolrResourceLoader; Using system property
solr.solr.home: F:\solr_server\solr-7.3.1\example\cloud\node2\solr
INFO  - 2018-06-28 09:24:58.525; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:24:58.533; [   ]
org.apache.solr.servlet.SolrDispatchFilter; Loading solr.xml from SolrHome
(not found in ZooKeeper)
INFO  - 2018-06-28 09:24:58.535; [   ] org.apache.solr.core.SolrXmlConfig;
Loading container configuration from
F:\solr_server\solr-7.3.1\example\cloud\node2\solr\solr.xml
INFO  - 2018-06-28 09:24:58.845; [   ] org.apache.solr.core.ZkContainer;
Zookeeper client=localhost:10999
INFO  - 2018-06-28 09:24:58.862; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:24:58.906; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (1)
INFO  - 2018-06-28 09:24:58.925; [   ] org.apache.solr.cloud.Overseer;
Overseer (id=null) closing
INFO  - 2018-06-28 09:24:58.937; [   ] org.apache.solr.cloud.ZkController;
Register node as live in ZooKeeper:/live_nodes/192.168.56.1:9998_solr
INFO  - 2018-06-28 09:24:58.948; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (1) -> (2)
INFO  - 2018-06-28 09:25:03.658; [   ]
org.apache.solr.core.CorePropertiesLocator; Found 0 core definitions
underneath F:\solr_server\solr-7.3.1\example\cloud\node2\solr
INFO  - 2018-06-28 09:25:03.680; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:25:03.681; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (2)
INFO  - 2018-06-28 09:25:03.683; [   ]
org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at
localhost:10999 ready
INFO  - 2018-06-28 09:25:03.891; [   ]
org.eclipse.jetty.server.handler.ContextHandler; Started
o.e.j.w.WebAppContext@436e852b
{/solr,file:///F:/solr_server/solr-7.3.1/server/solr-webapp/webapp/,AVAILABLE}{file:///F:/solr_server/solr-7.3.1/server//solr-webapp/webapp}
INFO  - 2018-06-28 09:25:03.908; [   ]
org.eclipse.jetty.server.AbstractConnector; Started ServerConnector@78d6692f
{HTTP/1.1,[http/1.1]}{0.0.0.0:9998}
INFO  - 2018-06-28 09:25:03.908; [   ] org.eclipse.jetty.server.Server;
Started @10823ms
INFO  - 2018-06-28 09:25:04.849; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=50
INFO  - 2018-06-28 09:25:04.873; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:25:04.876; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=3
INFO  - 2018-06-28 09:25:05.734; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=32
INFO  - 2018-06-28 09:25:05.737; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:25:05.738; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=1
INFO  - 2018-06-28 09:25:14.051; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (2) -> (3)
INFO  - 2018-06-28 09:25:14.051; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (2) -> (3)
INFO  - 2018-06-28 09:25:29.137; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
INFO  - 2018-06-28 09:25:29.137; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
...

...
INFO  - 2018-06-28 09:25:13.606; [   ] org.apache.solr.core.SolrXmlConfig;
Loading container configuration from
F:\solr_server\solr-7.3.1\example\cloud\node3\solr\solr.xml
INFO  - 2018-06-28 09:25:13.931; [   ] org.apache.solr.core.ZkContainer;
Zookeeper client=localhost:10999
INFO  - 2018-06-28 09:25:13.947; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:25:14.011; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (2)
INFO  - 2018-06-28 09:25:14.029; [   ] org.apache.solr.cloud.Overseer;
Overseer (id=null) closing
INFO  - 2018-06-28 09:25:14.042; [   ] org.apache.solr.cloud.ZkController;
Register node as live in ZooKeeper:/live_nodes/192.168.56.1:9997_solr
INFO  - 2018-06-28 09:25:14.053; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (2) -> (3)
INFO  - 2018-06-28 09:25:18.695; [   ]
org.apache.solr.core.CorePropertiesLocator; Found 0 core definitions
underneath F:\solr_server\solr-7.3.1\example\cloud\node3\solr
INFO  - 2018-06-28 09:25:18.718; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:25:18.720; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (3)
INFO  - 2018-06-28 09:25:18.722; [   ]
org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at
localhost:10999 ready
INFO  - 2018-06-28 09:25:18.935; [   ]
org.eclipse.jetty.server.handler.ContextHandler; Started
o.e.j.w.WebAppContext@436e852b
{/solr,file:///F:/solr_server/solr-7.3.1/server/solr-webapp/webapp/,AVAILABLE}{file:///F:/solr_server/solr-7.3.1/server//solr-webapp/webapp}
INFO  - 2018-06-28 09:25:18.943; [   ]
org.eclipse.jetty.server.AbstractConnector; Started ServerConnector@78d6692f
{HTTP/1.1,[http/1.1]}{0.0.0.0:9997}
INFO  - 2018-06-28 09:25:18.944; [   ] org.eclipse.jetty.server.Server;
Started @10767ms
INFO  - 2018-06-28 09:25:19.911; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=52
INFO  - 2018-06-28 09:25:19.936; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:25:19.939; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=3
INFO  - 2018-06-28 09:25:20.869; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/info/system params={wt=json} status=0 QTime=43
INFO  - 2018-06-28 09:25:20.872; [   ]
org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action
:clusterstatus with params action=CLUSTERSTATUS&wt=json and
sendToOCPQueue=true
INFO  - 2018-06-28 09:25:20.874; [   ]
org.apache.solr.servlet.HttpSolrCall; [admin] webapp=null
path=/admin/collections params={action=CLUSTERSTATUS&wt=json} status=0
QTime=1
INFO  - 2018-06-28 09:25:29.137; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
INFO  - 2018-06-28 09:25:29.138; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
...


...
INFO  - 2018-06-28 09:25:28.684; [   ] org.apache.solr.core.SolrXmlConfig;
Loading container configuration from
F:\solr_server\solr-7.3.1\example\cloud\node4\solr\solr.xml
INFO  - 2018-06-28 09:25:29.030; [   ] org.apache.solr.core.ZkContainer;
Zookeeper client=localhost:10999
INFO  - 2018-06-28 09:25:29.048; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:25:29.090; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (3)
INFO  - 2018-06-28 09:25:29.114; [   ] org.apache.solr.cloud.Overseer;
Overseer (id=null) closing
INFO  - 2018-06-28 09:25:29.127; [   ] org.apache.solr.cloud.ZkController;
Register node as live in ZooKeeper:/live_nodes/192.168.56.1:9996_solr
INFO  - 2018-06-28 09:25:29.139; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (3) -> (4)
INFO  - 2018-06-28 09:25:33.796; [   ]
org.apache.solr.core.CorePropertiesLocator; Found 0 core definitions
underneath F:\solr_server\solr-7.3.1\example\cloud\node4\solr
INFO  - 2018-06-28 09:25:33.818; [   ]
org.apache.solr.common.cloud.ConnectionManager; zkClient has connected
INFO  - 2018-06-28 09:25:33.821; [   ]
org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from
ZooKeeper... (0) -> (4)
INFO  - 2018-06-28 09:25:33.823; [   ]
org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster at
localhost:10999 ready
INFO  - 2018-06-28 09:25:34.031; [   ]
org.eclipse.jetty.server.handler.ContextHandler; Started
o.e.j.w.WebAppContext@436e852b
{/solr,file:///F:/solr_server/solr-7.3.1/server/solr-webapp/webapp/,AVAILABLE}{file:///F:/solr_server/solr-7.3.1/server//solr-webapp/webapp}
...


[6] F:\solr_server\solr-7.3.1\example\cloud\node1\solr\zoo.cfg :
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5

# the directory where the snapshot is stored.
# dataDir=/opt/zookeeper/data
# NOTE: Solr defaults the dataDir to <solrHome>/zoo_data

# the port at which the clients will connect
# clientPort=2181
# NOTE: Solr sets this based on zkRun / zkHost params

# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1

[7] F:\solr_server\solr-7.4.0>bin\solr.cmd start -cloud -p 7777 -s
"F:\solr_server\solr-7.4.0\example\cloud\node1\solr"
ERROR StatusLogger Unable to access
file:/F:/solr_server/solr-7.4.0/server/file:F:/solr_server/solr-7.4.0/server/scripts/cloud-scripts/log4j2.xml
 java.io.FileNotFoundException:
F:\solr_server\solr-7.4.0\server\file:F:\solr_server\solr-7.4.0\server\scripts\cloud-scripts\log4j2.xml
(The filename, directory name, or volume label syntax is incorrect)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:93)
        at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
        at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
        at java.net.URL.openStream(URL.java:1045)
        at
org.apache.logging.log4j.core.config.ConfigurationSource.fromUri(ConfigurationSource.java:247)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:404)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:346)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:260)
        at
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:615)
        at
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:636)
        at
org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:231)
        at
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153)
        at
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:45)
        at
org.apache.logging.log4j.LogManager.getContext(LogManager.java:194)
        at
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:121)
        at
org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
        at
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46)
        at
org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383)
        at org.apache.solr.util.SolrCLI.<clinit>(SolrCLI.java:228)
ERROR StatusLogger Unable to access
file:/F:/solr_server/solr-7.4.0/server/file:F:/solr_server/solr-7.4.0/example/resources/log4j2.xml
 java.io.FileNotFoundException:
F:\solr_server\solr-7.4.0\server\file:F:\solr_server\solr-7.4.0\example\resources\log4j2.xml
(The filename, directory name, or volume label syntax is incorrect)
        at java.io.FileInputStream.open0(Native Method)
        at java.io.FileInputStream.open(FileInputStream.java:195)
        at java.io.FileInputStream.<init>(FileInputStream.java:138)
        at java.io.FileInputStream.<init>(FileInputStream.java:93)
        at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
        at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
        at java.net.URL.openStream(URL.java:1045)
        at
org.apache.logging.log4j.core.config.ConfigurationSource.fromUri(ConfigurationSource.java:247)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:404)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory$Factory.getConfiguration(ConfigurationFactory.java:346)
        at
org.apache.logging.log4j.core.config.ConfigurationFactory.getConfiguration(ConfigurationFactory.java:260)
        at
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:615)
        at
org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:636)
        at
org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:231)
        at
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153)
        at
org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:45)
        at
org.apache.logging.log4j.LogManager.getContext(LogManager.java:194)
        at
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:121)
        at
org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
        at
org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46)
        at
org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
        at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:358)
        at org.eclipse.jetty.util.log.Slf4jLog.<init>(Slf4jLog.java:38)
        at org.eclipse.jetty.util.log.Slf4jLog.<init>(Slf4jLog.java:32)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.eclipse.jetty.util.log.Log.initialized(Log.java:178)
        at org.eclipse.jetty.util.log.Log.getLogger(Log.java:311)
        at org.eclipse.jetty.util.log.Log.getLogger(Log.java:301)
        at
org.eclipse.jetty.xml.XmlConfiguration.<clinit>(XmlConfiguration.java:80)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.eclipse.jetty.start.Main.invokeMain(Main.java:220)
        at org.eclipse.jetty.start.Main.start(Main.java:486)
        at org.eclipse.jetty.start.Main.main(Main.java:77)
INFO  - 2018-06-28 11:59:19.867;
org.apache.solr.util.configuration.SSLCredentialProviderFactory; Processing
SSL Credential Provider chain: env;sysprop
Waiting up to 30 to see Solr running on port 7777
Reply | Threaded
Open this post in threaded view
|

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

Shawn Heisey-2
On 6/28/2018 4:03 AM, Arturas Mazeika wrote:
> f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat -zkhost
> localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname
> de_wiki_man
>
> Caused by: java.io.IOException: Unable to establish loopback connection

Take a look at this SO answer (for android software, not Solr):

https://stackoverflow.com/a/42548312/2665648

You can't use that exact solution, because the _JAVA_OPTIONS environment
variable is not used by Solr or its startup script.  But I think the
underlying problem might be what you're running into:  There may be a
problem with the ipv6 setup on your system.

If you change the address in the command from localhost to 127.0.0.1,
that might fix the problem.

Setting the system property to prefer IPv4 addresses would need to
happen in the zkcli script to fix this command.

Or you can fix the network stack in Windows.  Either set up IPv6
properly, or remove IPv6 entirely.  If you do not actually have ipv6 in
your network, you might try this command on a command prompt that has
privilege elevation:

netsh int ipv6 reset ipv6reset.log

A reboot might be required after that command.

What happens if you type 'ping localhost' from a command prompt?  This
is what I get, indicating that the local ipv6 address is working:

C:\Users\sheisey>ping localhost

Pinging purgatory.REDACTED.com [::1] with 32 bytes of data:
Reply from ::1: time<1ms
Reply from ::1: time<1ms
Reply from ::1: time<1ms
Reply from ::1: time<1ms

Thanks,
Shawn

Reply | Threaded
Open this post in threaded view
|

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

Arturas Mazeika
Hi Shawn, et al,

I haven't thought about ip6. Interesting idea.

- I've tried to use the address 127.0.0.1. It did not help (I've
un-commented the suppress-output-line in the script, so it is possible to
see what it is being done) [1]. I also tried all possible combinations of
the IP addresses that got assigned through the net cards without no success
[2]. There is some 10sec delay between the start of the command and the
error.

- I also reset ip6v as you suggested without any success [3].

- ping returns in my case as in yours [4].

- ipconfig /all returns [5].

- Then I disables ipv6 on the network card. No change.

- Then I found

https://superuser.com/questions/586144/disable-ipv6-loopback-on-windows-7-64-bit

and did [6]. No change.

I restarted the cluster with -z 127.0.0.1:10999 [6]. No change.

Any comments are very helpful.

Cheers,
Arturas

References:

[1]
F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat
-zkhost 127.0.0.1:10999 -cmd downconfig -confdir d:\de_wiki_man_config2
-confname de_wiki_man

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can override
pass the following parameters to this script:

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM  Find location
of this script

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set
SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set
SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined
LOG4J_PROPS (set "LOG4J_CONFIG=file:" )  else (set
"LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
)

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for ZK
ACL

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set
SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkCredentialsProvider=org.apache.solr.common.cloud.VMParamsSingleSetCredentialsDigestZkCredentialsProvider
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkDigestReadonlyUsername=readonly-user
-DzkDigestReadonlyPassword=CHANGEME-READONLY-PASSWORD

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java"
-Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath
"f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig
-confdir d:\de_wiki_man_config2 -confname de_wiki_man

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java"
-Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
-Djava.net.preferIPv4Stack=true -classpath
"f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig
-confdir d:\de_wiki_man_config2 -confname de_wiki_man
Exception in thread "main" org.apache.solr.common.SolrException:
java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:119)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:109)
        at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197)
Caused by: java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
        at
org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
        at
org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
        at
org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:148)
        ... 3 more
Caused by: java.io.IOException: Unable to establish loopback connection
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.nio.ch.PipeImpl.<init>(Unknown Source)
        at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source)
        at java.nio.channels.Pipe.open(Unknown Source)
        at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source)
        at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source)
        at java.nio.channels.Selector.open(Unknown Source)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
Source)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839)
        ... 9 more
Caused by: java.net.ConnectException: Connection timed out: connect
        at sun.nio.ch.Net.connect0(Native Method)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
        at java.nio.channels.SocketChannel.open(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown
Source)
        ... 25 more


F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat
-zkhost 172.16.203.123:10999 -cmd downconfig -confdir
d:\de_wiki_man_config2 -confname de_wiki_man

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can override
pass the following parameters to this script:

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM  Find location
of this script

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set
SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set
SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined
LOG4J_PROPS (set "LOG4J_CONFIG=file:" )  else (set
"LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
)

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for ZK
ACL

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set
SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkCredentialsProvider=org.apache.solr.common.cloud.VMParamsSingleSetCredentialsDigestZkCredentialsProvider
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
-DzkDigestReadonlyUsername=readonly-user
-DzkDigestReadonlyPassword=CHANGEME-READONLY-PASSWORD

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java"
-Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
^

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath
"f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig
-confdir d:\de_wiki_man_config2 -confname de_wiki_man

F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java"
-Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties"
-Djava.net.preferIPv4Stack=true -classpath
"f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig
-confdir d:\de_wiki_man_config2 -confname de_wiki_man
Exception in thread "main" org.apache.solr.common.SolrException:
java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:119)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:109)
        at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197)
Caused by: java.io.IOException: Couldn't instantiate
org.apache.zookeeper.ClientCnxnSocketNIO
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
        at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
        at
org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
        at
org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
        at
org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
        at
org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:148)
        ... 3 more
Caused by: java.io.IOException: Unable to establish loopback connection
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.nio.ch.PipeImpl.<init>(Unknown Source)
        at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source)
        at java.nio.channels.Pipe.open(Unknown Source)
        at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source)
        at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source)
        at java.nio.channels.Selector.open(Unknown Source)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
Source)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        at
org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839)
        ... 9 more
Caused by: java.net.ConnectException: Connection timed out: connect
        at sun.nio.ch.Net.connect0(Native Method)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.Net.connect(Unknown Source)
        at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
        at java.nio.channels.SocketChannel.open(Unknown Source)
        at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown
Source)
        ... 25 more



[3] C:\temp>netsh int ipv6 reset ipv6reset.log
Resetting Compartment Forwarding, OK!
Resetting Compartment, OK!
Resetting Control Protocol, OK!
Resetting Echo Sequence Request, OK!
Resetting Global, OK!
Resetting Interface, OK!
Resetting Anycast Address, OK!
Resetting Multicast Address, OK!
Resetting Unicast Address, OK!
Resetting Neighbor, OK!
Resetting Path, OK!
Resetting Potential, OK!
Resetting Prefix Policy, OK!
Resetting Proxy Neighbor, OK!
Resetting Route, OK!
Resetting Site Prefix, OK!
Resetting Subinterface, OK!
Resetting Wakeup Pattern, OK!
Resetting Resolve Neighbor, OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , failed.
Access is denied.

Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Resetting , OK!
Restart the computer to complete this action.

[4] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ping localhost

Pinging Arteika.xxx [::1] with 32 bytes of data:
Reply from ::1: time<1ms
Reply from ::1: time<1ms
Reply from ::1: time<1ms
Reply from ::1: time<1ms

Ping statistics for ::1:
    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms


[5]
F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ipconfig /all

Windows IP Configuration

   Host Name . . . . . . . . . . . . : Arteika
   Primary Dns Suffix  . . . . . . . : xxx
   Node Type . . . . . . . . . . . . : Hybrid
   IP Routing Enabled. . . . . . . . : No
   WINS Proxy Enabled. . . . . . . . : No
   DNS Suffix Search List. . . . . . : xxx

Ethernet adapter Ethernet:

   Connection-specific DNS Suffix  . : xxx
   Description . . . . . . . . . . . : Intel(R) Ethernet Connection (2)
I219-LM
   Physical Address. . . . . . . . . : 18-66-DA-22-85-02
   DHCP Enabled. . . . . . . . . . . : Yes
   Autoconfiguration Enabled . . . . : Yes
   Link-local IPv6 Address . . . . . :
fe80::39e5:577e:5cf8:5fcc%6(Preferred)
   IPv4 Address. . . . . . . . . . . : 172.16.203.123(Preferred)
   Subnet Mask . . . . . . . . . . . : 255.255.248.0
   Lease Obtained. . . . . . . . . . : Thursday, June 28, 2018 5:13:28 PM
   Lease Expires . . . . . . . . . . : Thursday, June 28, 2018 7:13:27 PM
   Default Gateway . . . . . . . . . : 172.16.200.10
   DHCP Server . . . . . . . . . . . : 172.16.200.10
   DHCPv6 IAID . . . . . . . . . . . : 55614028
   DHCPv6 Client DUID. . . . . . . . :
00-01-00-01-22-3D-C3-09-18-66-DA-22-85-02
   DNS Servers . . . . . . . . . . . : 172.16.200.50
   NetBIOS over Tcpip. . . . . . . . : Enabled

Ethernet adapter VirtualBox Host-Only Network #2:

   Connection-specific DNS Suffix  . :
   Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet
Adapter #2
   Physical Address. . . . . . . . . : 0A-00-27-00-00-03
   DHCP Enabled. . . . . . . . . . . : No
   Autoconfiguration Enabled . . . . : Yes
   Link-local IPv6 Address . . . . . :
fe80::b40b:85fe:cf77:ac82%3(Preferred)
   IPv4 Address. . . . . . . . . . . : 192.168.56.1(Preferred)
   Subnet Mask . . . . . . . . . . . : 255.255.255.0
   Default Gateway . . . . . . . . . :
   DHCPv6 IAID . . . . . . . . . . . : 285868071
   DHCPv6 Client DUID. . . . . . . . :
00-01-00-01-22-3D-C3-09-18-66-DA-22-85-02
   DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1
                                       fec0:0:0:ffff::2%1
                                       fec0:0:0:ffff::3%1
   NetBIOS over Tcpip. . . . . . . . : Enabled

[6]C:\WINDOWS\system32>netsh interface ipv6 set prefix ::/96 60 3
Ok.


C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies
Querying active state...

Precedence  Label  Prefix
----------  -----  --------------------------------
        60      3  ::/96
        50      0  ::1/128
        40      1  ::/0
        35      4  ::ffff:0:0/96
        30      2  2002::/16
         5      5  2001::/32
         3     13  fc00::/7
         1     12  3ffe::/16
         1     11  fec0::/10


C:\WINDOWS\system32>ping localhost

Pinging Arteika.xxx [::1] with 32 bytes of data:
Reply from ::1: time<1ms
Reply from ::1: time<1ms

Ping statistics for ::1:
    Packets: Sent = 2, Received = 2, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms
Control-C
^C
C:\WINDOWS\system32>netsh interface ipv6 set prefix ::ffff:0:0/96 55 4
Ok.


C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies
Querying active state...

Precedence  Label  Prefix
----------  -----  --------------------------------
        60      3  ::/96
        55      4  ::ffff:0:0/96
        50      0  ::1/128
        40      1  ::/0
        30      2  2002::/16
         5      5  2001::/32
         3     13  fc00::/7
         1     12  3ffe::/16
         1     11  fec0::/10


C:\WINDOWS\system32>ping localhost

Pinging Arteika.xxx [127.0.0.1] with 32 bytes of data:
Reply from 127.0.0.1: bytes=32 time<1ms TTL=128
Reply from 127.0.0.1: bytes=32 time<1ms TTL=128

Ping statistics for 127.0.0.1:
    Packets: Sent = 2, Received = 2, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 0ms, Maximum = 0ms, Average = 0ms

[7]
"F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9999 -s
"F:\solr_server\solr-7.2.1\example\cloud\node1\solr"
"F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9998 -s
"F:\solr_server\solr-7.2.1\example\cloud\node2\solr" -z 127.0.0.1:10999
"F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9997 -s
"F:\solr_server\solr-7.2.1\example\cloud\node3\solr" -z 127.0.0.1:10999
"F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9996 -s
"F:\solr_server\solr-7.2.1\example\cloud\node4\solr" -z 127.0.0.1:10999





On Thu, Jun 28, 2018 at 4:13 PM, Shawn Heisey <[hidden email]> wrote:

> On 6/28/2018 4:03 AM, Arturas Mazeika wrote:
> > f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat -zkhost
> > localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname
> > de_wiki_man
> >
> > Caused by: java.io.IOException: Unable to establish loopback connection
>
> Take a look at this SO answer (for android software, not Solr):
>
> https://stackoverflow.com/a/42548312/2665648
>
> You can't use that exact solution, because the _JAVA_OPTIONS environment
> variable is not used by Solr or its startup script.  But I think the
> underlying problem might be what you're running into:  There may be a
> problem with the ipv6 setup on your system.
>
> If you change the address in the command from localhost to 127.0.0.1,
> that might fix the problem.
>
> Setting the system property to prefer IPv4 addresses would need to
> happen in the zkcli script to fix this command.
>
> Or you can fix the network stack in Windows.  Either set up IPv6
> properly, or remove IPv6 entirely.  If you do not actually have ipv6 in
> your network, you might try this command on a command prompt that has
> privilege elevation:
>
> netsh int ipv6 reset ipv6reset.log
>
> A reboot might be required after that command.
>
> What happens if you type 'ping localhost' from a command prompt?  This
> is what I get, indicating that the local ipv6 address is working:
>
> C:\Users\sheisey>ping localhost
>
> Pinging purgatory.REDACTED.com [::1] with 32 bytes of data:
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
>
> Thanks,
> Shawn
>
>
Reply | Threaded
Open this post in threaded view
|

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

Arturas Mazeika
Hi Shawn et al,


I think I got it working.

I disabled the firewall, and then I was able to download and upload the
configdirs.

Interestingly enough, after I re-enabled the firewall, I was able to
continue to upload and download the configdirs. As if the problem did not
take place at all. I am highly puzzled. Comments are very welcome.

I'll keep an eye on what's going on and keep you guys informed. Thanks for
the support!!

Cheers,
Arturas







On Thu, Jun 28, 2018 at 6:07 PM, Arturas Mazeika <[hidden email]> wrote:

> Hi Shawn, et al,
>
> I haven't thought about ip6. Interesting idea.
>
> - I've tried to use the address 127.0.0.1. It did not help (I've
> un-commented the suppress-output-line in the script, so it is possible to
> see what it is being done) [1]. I also tried all possible combinations of
> the IP addresses that got assigned through the net cards without no success
> [2]. There is some 10sec delay between the start of the command and the
> error.
>
> - I also reset ip6v as you suggested without any success [3].
>
> - ping returns in my case as in yours [4].
>
> - ipconfig /all returns [5].
>
> - Then I disables ipv6 on the network card. No change.
>
> - Then I found
>
> https://superuser.com/questions/586144/disable-ipv6-loopback
> -on-windows-7-64-bit
>
> and did [6]. No change.
>
> I restarted the cluster with -z 127.0.0.1:10999 [6]. No change.
>
> Any comments are very helpful.
>
> Cheers,
> Arturas
>
> References:
>
> [1] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\
> solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat -zkhost
> 127.0.0.1:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname
> de_wiki_man
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can
> override pass the following parameters to this script:
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM  Find location
> of this script
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set
> SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set
> SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined
> LOG4J_PROPS (set "LOG4J_CONFIG=file:" )  else (set
> "LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\
> cloud-scripts\log4j.properties" )
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for
> ZK ACL
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set
> SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.
> common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkCredentialsProvider=org.apache.solr.common.cloud.VMParam
> sSingleSetCredentialsDigestZkCredentialsProvider ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkDigestReadonlyUsername=readonly-user -DzkDigestReadonlyPassword=CHA
> NGEME-READONLY-PASSWORD
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java"
> -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server
> \scripts\cloud-scripts\log4j.properties" ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath
> "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\.
> .\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.
> 1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_
> server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
> org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig
> -confdir d:\de_wiki_man_config2 -confname de_wiki_man
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java"
> -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server
> \scripts\cloud-scripts\log4j.properties" -Djava.net.preferIPv4Stack=true
> -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\.
> .\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.
> 1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_
> server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
> org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig
> -confdir d:\de_wiki_man_config2 -confname de_wiki_man
> Exception in thread "main" org.apache.solr.common.SolrException:
> java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnx
> nSocketNIO
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:170)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:119)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:109)
>         at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197)
> Caused by: java.io.IOException: Couldn't instantiate
> org.apache.zookeeper.ClientCnxnSocketNIO
>         at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper
> .java:1842)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
>         at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKee
> per.java:43)
>         at org.apache.solr.common.cloud.ZkClientConnectionStrategy.crea
> teSolrZooKeeper(ZkClientConnectionStrategy.java:105)
>         at org.apache.solr.common.cloud.DefaultConnectionStrategy.conne
> ct(DefaultConnectionStrategy.java:37)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:148)
>         ... 3 more
> Caused by: java.io.IOException: Unable to establish loopback connection
>         at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
>         at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at sun.nio.ch.PipeImpl.<init>(Unknown Source)
>         at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source)
>         at java.nio.channels.Pipe.open(Unknown Source)
>         at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source)
>         at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source)
>         at java.nio.channels.Selector.open(Unknown Source)
>         at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSo
> cketNIO.java:43)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
> Source)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown
> Source)
>         at java.lang.reflect.Constructor.newInstance(Unknown Source)
>         at java.lang.Class.newInstance(Unknown Source)
>         at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper
> .java:1839)
>         ... 9 more
> Caused by: java.net.ConnectException: Connection timed out: connect
>         at sun.nio.ch.Net.connect0(Native Method)
>         at sun.nio.ch.Net.connect(Unknown Source)
>         at sun.nio.ch.Net.connect(Unknown Source)
>         at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
>         at java.nio.channels.SocketChannel.open(Unknown Source)
>         at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown
> Source)
>         ... 25 more
>
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\
> solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat -zkhost
> 172.16.203.123:10999 -cmd downconfig -confdir d:\de_wiki_man_config2
> -confname de_wiki_man
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can
> override pass the following parameters to this script:
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM  Find location
> of this script
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set
> SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set
> SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined
> LOG4J_PROPS (set "LOG4J_CONFIG=file:" )  else (set
> "LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\
> cloud-scripts\log4j.properties" )
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for
> ZK ACL
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set
> SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.
> common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkCredentialsProvider=org.apache.solr.common.cloud.VMParam
> sSingleSetCredentialsDigestZkCredentialsProvider ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM
> -DzkDigestReadonlyUsername=readonly-user -DzkDigestReadonlyPassword=CHA
> NGEME-READONLY-PASSWORD
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java"
> -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server
> \scripts\cloud-scripts\log4j.properties" ^
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath
> "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\.
> .\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.
> 1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_
> server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
> org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig
> -confdir d:\de_wiki_man_config2 -confname de_wiki_man
>
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java"
> -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server
> \scripts\cloud-scripts\log4j.properties" -Djava.net.preferIPv4Stack=true
> -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\.
> .\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.
> 1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_
> server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*"
> org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig
> -confdir d:\de_wiki_man_config2 -confname de_wiki_man
> Exception in thread "main" org.apache.solr.common.SolrException:
> java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnx
> nSocketNIO
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:170)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:119)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:109)
>         at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197)
> Caused by: java.io.IOException: Couldn't instantiate
> org.apache.zookeeper.ClientCnxnSocketNIO
>         at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper
> .java:1842)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
>         at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
>         at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKee
> per.java:43)
>         at org.apache.solr.common.cloud.ZkClientConnectionStrategy.crea
> teSolrZooKeeper(ZkClientConnectionStrategy.java:105)
>         at org.apache.solr.common.cloud.DefaultConnectionStrategy.conne
> ct(DefaultConnectionStrategy.java:37)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClien
> t.java:148)
>         ... 3 more
> Caused by: java.io.IOException: Unable to establish loopback connection
>         at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
>         at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at sun.nio.ch.PipeImpl.<init>(Unknown Source)
>         at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source)
>         at java.nio.channels.Pipe.open(Unknown Source)
>         at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source)
>         at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source)
>         at java.nio.channels.Selector.open(Unknown Source)
>         at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSo
> cketNIO.java:43)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown
> Source)
>         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown
> Source)
>         at java.lang.reflect.Constructor.newInstance(Unknown Source)
>         at java.lang.Class.newInstance(Unknown Source)
>         at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper
> .java:1839)
>         ... 9 more
> Caused by: java.net.ConnectException: Connection timed out: connect
>         at sun.nio.ch.Net.connect0(Native Method)
>         at sun.nio.ch.Net.connect(Unknown Source)
>         at sun.nio.ch.Net.connect(Unknown Source)
>         at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
>         at java.nio.channels.SocketChannel.open(Unknown Source)
>         at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown
> Source)
>         ... 25 more
>
>
>
> [3] C:\temp>netsh int ipv6 reset ipv6reset.log
> Resetting Compartment Forwarding, OK!
> Resetting Compartment, OK!
> Resetting Control Protocol, OK!
> Resetting Echo Sequence Request, OK!
> Resetting Global, OK!
> Resetting Interface, OK!
> Resetting Anycast Address, OK!
> Resetting Multicast Address, OK!
> Resetting Unicast Address, OK!
> Resetting Neighbor, OK!
> Resetting Path, OK!
> Resetting Potential, OK!
> Resetting Prefix Policy, OK!
> Resetting Proxy Neighbor, OK!
> Resetting Route, OK!
> Resetting Site Prefix, OK!
> Resetting Subinterface, OK!
> Resetting Wakeup Pattern, OK!
> Resetting Resolve Neighbor, OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , failed.
> Access is denied.
>
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Resetting , OK!
> Restart the computer to complete this action.
>
> [4] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ping localhost
>
> Pinging Arteika.xxx [::1] with 32 bytes of data:
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
>
> Ping statistics for ::1:
>     Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
> Approximate round trip times in milli-seconds:
>     Minimum = 0ms, Maximum = 0ms, Average = 0ms
>
>
> [5]
> F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ipconfig /all
>
> Windows IP Configuration
>
>    Host Name . . . . . . . . . . . . : Arteika
>    Primary Dns Suffix  . . . . . . . : xxx
>    Node Type . . . . . . . . . . . . : Hybrid
>    IP Routing Enabled. . . . . . . . : No
>    WINS Proxy Enabled. . . . . . . . : No
>    DNS Suffix Search List. . . . . . : xxx
>
> Ethernet adapter Ethernet:
>
>    Connection-specific DNS Suffix  . : xxx
>    Description . . . . . . . . . . . : Intel(R) Ethernet Connection (2)
> I219-LM
>    Physical Address. . . . . . . . . : 18-66-DA-22-85-02
>    DHCP Enabled. . . . . . . . . . . : Yes
>    Autoconfiguration Enabled . . . . : Yes
>    Link-local IPv6 Address . . . . . : fe80::39e5:577e:5cf8:5fcc%6(Pr
> eferred)
>    IPv4 Address. . . . . . . . . . . : 172.16.203.123(Preferred)
>    Subnet Mask . . . . . . . . . . . : 255.255.248.0
>    Lease Obtained. . . . . . . . . . : Thursday, June 28, 2018 5:13:28 PM
>    Lease Expires . . . . . . . . . . : Thursday, June 28, 2018 7:13:27 PM
>    Default Gateway . . . . . . . . . : 172.16.200.10
>    DHCP Server . . . . . . . . . . . : 172.16.200.10
>    DHCPv6 IAID . . . . . . . . . . . : 55614028
>    DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-22-3D-C3-09-18-66-
> DA-22-85-02
>    DNS Servers . . . . . . . . . . . : 172.16.200.50
>    NetBIOS over Tcpip. . . . . . . . : Enabled
>
> Ethernet adapter VirtualBox Host-Only Network #2:
>
>    Connection-specific DNS Suffix  . :
>    Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet
> Adapter #2
>    Physical Address. . . . . . . . . : 0A-00-27-00-00-03
>    DHCP Enabled. . . . . . . . . . . : No
>    Autoconfiguration Enabled . . . . : Yes
>    Link-local IPv6 Address . . . . . : fe80::b40b:85fe:cf77:ac82%3(Pr
> eferred)
>    IPv4 Address. . . . . . . . . . . : 192.168.56.1(Preferred)
>    Subnet Mask . . . . . . . . . . . : 255.255.255.0
>    Default Gateway . . . . . . . . . :
>    DHCPv6 IAID . . . . . . . . . . . : 285868071
>    DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-22-3D-C3-09-18-66-
> DA-22-85-02
>    DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1
>                                        fec0:0:0:ffff::2%1
>                                        fec0:0:0:ffff::3%1
>    NetBIOS over Tcpip. . . . . . . . : Enabled
>
> [6]C:\WINDOWS\system32>netsh interface ipv6 set prefix ::/96 60 3
> Ok.
>
>
> C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies
> Querying active state...
>
> Precedence  Label  Prefix
> ----------  -----  --------------------------------
>         60      3  ::/96
>         50      0  ::1/128
>         40      1  ::/0
>         35      4  ::ffff:0:0/96
>         30      2  2002::/16
>          5      5  2001::/32
>          3     13  fc00::/7
>          1     12  3ffe::/16
>          1     11  fec0::/10
>
>
> C:\WINDOWS\system32>ping localhost
>
> Pinging Arteika.xxx [::1] with 32 bytes of data:
> Reply from ::1: time<1ms
> Reply from ::1: time<1ms
>
> Ping statistics for ::1:
>     Packets: Sent = 2, Received = 2, Lost = 0 (0% loss),
> Approximate round trip times in milli-seconds:
>     Minimum = 0ms, Maximum = 0ms, Average = 0ms
> Control-C
> ^C
> C:\WINDOWS\system32>netsh interface ipv6 set prefix ::ffff:0:0/96 55 4
> Ok.
>
>
> C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies
> Querying active state...
>
> Precedence  Label  Prefix
> ----------  -----  --------------------------------
>         60      3  ::/96
>         55      4  ::ffff:0:0/96
>         50      0  ::1/128
>         40      1  ::/0
>         30      2  2002::/16
>          5      5  2001::/32
>          3     13  fc00::/7
>          1     12  3ffe::/16
>          1     11  fec0::/10
>
>
> C:\WINDOWS\system32>ping localhost
>
> Pinging Arteika.xxx [127.0.0.1] with 32 bytes of data:
> Reply from 127.0.0.1: bytes=32 time<1ms TTL=128
> Reply from 127.0.0.1: bytes=32 time<1ms TTL=128
>
> Ping statistics for 127.0.0.1:
>     Packets: Sent = 2, Received = 2, Lost = 0 (0% loss),
> Approximate round trip times in milli-seconds:
>     Minimum = 0ms, Maximum = 0ms, Average = 0ms
>
> [7]
> "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9999 -s
> "F:\solr_server\solr-7.2.1\example\cloud\node1\solr"
> "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9998 -s
> "F:\solr_server\solr-7.2.1\example\cloud\node2\solr" -z 127.0.0.1:10999
> "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9997 -s
> "F:\solr_server\solr-7.2.1\example\cloud\node3\solr" -z 127.0.0.1:10999
> "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9996 -s
> "F:\solr_server\solr-7.2.1\example\cloud\node4\solr" -z 127.0.0.1:10999
>
>
>
>
>
> On Thu, Jun 28, 2018 at 4:13 PM, Shawn Heisey <[hidden email]> wrote:
>
>> On 6/28/2018 4:03 AM, Arturas Mazeika wrote:
>> > f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat
>> -zkhost
>> > localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname
>> > de_wiki_man
>> >
>> > Caused by: java.io.IOException: Unable to establish loopback connection
>>
>> Take a look at this SO answer (for android software, not Solr):
>>
>> https://stackoverflow.com/a/42548312/2665648
>>
>> You can't use that exact solution, because the _JAVA_OPTIONS environment
>> variable is not used by Solr or its startup script.  But I think the
>> underlying problem might be what you're running into:  There may be a
>> problem with the ipv6 setup on your system.
>>
>> If you change the address in the command from localhost to 127.0.0.1,
>> that might fix the problem.
>>
>> Setting the system property to prefer IPv4 addresses would need to
>> happen in the zkcli script to fix this command.
>>
>> Or you can fix the network stack in Windows.  Either set up IPv6
>> properly, or remove IPv6 entirely.  If you do not actually have ipv6 in
>> your network, you might try this command on a command prompt that has
>> privilege elevation:
>>
>> netsh int ipv6 reset ipv6reset.log
>>
>> A reboot might be required after that command.
>>
>> What happens if you type 'ping localhost' from a command prompt?  This
>> is what I get, indicating that the local ipv6 address is working:
>>
>> C:\Users\sheisey>ping localhost
>>
>> Pinging purgatory.REDACTED.com [::1] with 32 bytes of data:
>> Reply from ::1: time<1ms
>> Reply from ::1: time<1ms
>> Reply from ::1: time<1ms
>> Reply from ::1: time<1ms
>>
>> Thanks,
>> Shawn
>>
>>
>