Re-crawling Problem

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Re-crawling Problem

Luca123
Hi all,
I'm having same trouble trying to carawl and recrawl my local
filesystem. I'm using the script posted at
http://wiki.apache.org/nutch/IntranetRecrawl


My filesystem is made like this:

../
../first/
../first/file1.pdf
../first/second/
../first/second/file2.pdf
../first/second/third
../first/second/third/file2.pdf
../first/second/third/fourth/
../first/second/third/fourth/file4.pdf
../first/second/third/fourth/fifth
../first/second/third/fourth/fifth/file5.pdf


On the first crawl "round" everything seems fine....it stops at the
"first" directory (depth 1)
On the first recrawl(depth 3) it stops at the "third" directory and all
the files seem indexed correctly.
On the second recrawl(always depth 3) it arrives at the fifth diretory
but none of the files are indexed.

any idea?
thanks
Luca