Quantcast

Nutch 2.3.1: REST API calls stop and abort failed to stop running jobs

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Nutch 2.3.1: REST API calls stop and abort failed to stop running jobs

Vladimir Loubenski
Hi there,
I have installed Nutch 2.3.1 .

During running Fetch or Parse Nutch job I call REST API abort (GET /job/job-id-5977/abort) or stop (GET /job/job-id-5977/stop) to Nutch server.

I can see in debugger that the call end up in Hadoop call   currentJob.killJob() in both cases.

The job continue to run and in hadoop log file I see: INFO  mapreduce.Job - Job job_local827431513_0001 failed with state KILLED due to: NA .

The abort and stop calls failed to stop the Nutch job.

After with  GET /job/job-id-5977  I receive

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

  "result" : null,

  "state" : "FAILED",

  "msg" : "ERROR: java.lang.RuntimeException: job failed: name=[crawl-00]fetch, jobid=job_local367443839_0005",

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

Is it Nutch 2.3.1 bug?

Regards,
Vladimir.
Loading...