Help need Nutch crawler.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Help need Nutch crawler.

Rajpaul Cheenath

Hi,

 

When I try to run the crawl, I am getting same log message continues.

Please see the below messages.

 

060227 171540  map -527635104%  reduce 0%

060227 171541 urls\urls.txt:0+24

060227 171541  map -527978816%  reduce 0%

060227 171542 urls\urls.txt:0+24

060227 171542  map -528316000%  reduce 0%

060227 171543 urls\urls.txt:0+24

060227 171543  map -528659808%  reduce 0%

060227 171544 urls\urls.txt:0+24

060227 171544  map -529003808%  reduce 0%

060227 171545 urls\urls.txt:0+24

060227 171545  map -529345440%  reduce 0%

060227 171546 urls\urls.txt:0+24

060227 171546  map -529676160%  reduce 0%

060227 171547 urls\urls.txt:0+24

060227 171547  map -530012960%  reduce 0%

 

The steps I done to run the nutch,

 

  1. Created a text file urls and added my url to it.
  2. Updated the crawl-urlfilter.txt for the same.
  3. run the crawl (getting the above messages)

 

Please explain me why I am getting this continues map reduce message.

 

Thanks

Raj Paul

 


disclaimer.txt (1K) Download Attachment