Nutch on windows with cygwin.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Nutch on windows with cygwin.

Yundeng Cao
i configurate my nutch project according to the FAQ. but some exception
throws when i run the following command:

$ ./bin/nutch crawl urls -dir crawl.demo -depth 2 -threads 4

Exception:

crawl started in: crawl.demo
rootUrlDir = urls
threads = 4
depth = 2
Injector: starting
Injector: crawlDb: crawl.demo/crawldb
Injector: urlDir: urls
Injector: Converting injected urls to crawl db entries.
Exception in thread "main" java.io.IOException: Input directory
C:/cygwin/opt/nu
tch/urls in local is invalid.
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:274)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:327)
        at org.apache.nutch.crawl.Injector.inject(Injector.java:138)
        at org.apache.nutch.crawl.Crawl.main(Crawl.java:105)

P.S. File urls already exists.