java.net.SocketException: Connection reset when using too many threads

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

java.net.SocketException: Connection reset when using too many threads

Tranquil
Hello,

i've noticed that when i use threads (more than 1/2) on my PC when running
fetch,
a lot of sites fail with "connection reset" or "read time out".. exceptions,
and when i reduce the number of threads the amount of errors reduces as
well.

I understand that the system must have a limit of threads it can handle,
my questions is:

   1.  how can you know the optimal number of threads to use before
   getting exceptions
   2. is there a way to config OS or nutch to work with more threads
   without getting exceptions?

thanks!

--
Eyal Edri