merging auto-crawls

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

merging auto-crawls

Ben Halsted
Hi All,

I've tried at nutch-user with no success. Can someone help me with the below
questions?

Thanks!

---------- Forwarded message ----------
From: Ben Halsted <[hidden email]>
Date: Nov 18, 2005 10:44 PM
Subject: merging auto-crawls
To: [hidden email]

Hello,

(Using the latest compiled SVN mapred branch)

I've modified the auto-crawl to always use a pre-existing crawldb. If I run
it multiple times I get multiple linkdb, segments, indexes, and index
directories.

Is it possible to merge the results using the bin/nutch comamnds?

Thanks!
Ben