Recently I encountered some problems with CDCR after we experienced network
problems, I thought I'd share.
I'm using Solr 7.2.0
We have 3 solr cloud instances where we update one cloud and use cdcr to
forward updates to the two solrclouds that are hosted in a cloud.
Usually this works pretty well.
Recently we have experienced some serious but intermittent network issues.
When that occurs we find that we get tons of cdcr warnings:
CdcrReplicator Failed to forward update request to target:
with errors like ClassCastException, and/or NullpointerException etc...
Updates accumulate on the server and it has tons of errors in the
When I looked around on the source collection, I found tlog files like this:
-rw-r--r-- 1 apache apache 1376736 May 10 23:04
*-rw-r--r-- 1 apache apache 0 May 11 23:05
*-rw-r--r-- 1 apache apache 65458 May 12 07:50
-rw-r--r-- 1 apache apache 1355610 May 18 10:05
-rw-r--r-- 1 apache apache 1355610 May 18 10:16
-rw-r--r-- 1 apache apache 1355610 May 18 10:21
-rw-r--r-- 1 apache apache 1355610 May 18 10:29
Note the 0 length file, and the truncated file
The solution is to delete these files. Once these files are removed the
updates start flowing
These errors show up as warnings in the log, I would have expected them to
be errors. CDCR doesn't seem to be able to detect that the tlog is
Hope this helps someone else. If there are better solutions, I'd like to
This message and any attachment are confidential and may be
otherwise protected from disclosure. If you are not the intended
you must not copy this message or attachment or disclose the
any other person. If you have received this transmission in error,
notify the sender immediately and delete the message and any attachment
from your system. Merck KGaA, Darmstadt, Germany and any of its
not accept liability for any omissions or errors in this
message which may
arise as a result of E-Mail-transmission or for damages
resulting from any
unauthorized changes of the content of this message and
any attachment thereto.
Merck KGaA, Darmstadt, Germany and any of its
subsidiaries do not guarantee
that this message is free of viruses and does
not accept liability for any
damages caused by any virus transmitted