Fetcher crashes after fetching 500 urls

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Fetcher crashes after fetching 500 urls

Mike Smith-8
I've been trying to fetch almost 10000 pages with depth 1. Fetcher fetches
the first 500 urls and then it keeps giving these errors:
 On Windows (XP): failed with: java.lang.Exception:
Java.net.SocketTimeoutException: connect timed out
 On Linux (Red Hat): failed with: java.lang.Exception:
java.net.ConnectException: No buffer space available
 Nutch 0.7.1
RAM 1G
Connection 10 MB/S
 Thanks, Mike