Fetcher slow at very end

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Fetcher slow at very end

Benjamin Higgins
Hi all,

I am running Nutch 0.8.1, on one machine, indexing one site using one
fetcher thread.  The problem is that the fetcher will fetch pages just fine,
but then it stalls for a fairly long time (10 minutes? maybe more?) before
it finally says "Fetcher: done".

What's going on at this point?  What's taking so long?  Can it be sped up?