[jira] [Updated] (NUTCH-2341) bin/crawl do not fetch batchId generated by bash script

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (NUTCH-2341) bin/crawl do not fetch batchId generated by bash script

David Eric Pugh (Jira)

     [ https://issues.apache.org/jira/browse/NUTCH-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel updated NUTCH-2341:
-----------------------------------
    Fix Version/s: 2.5

> bin/crawl do not fetch batchId generated by bash script
> -------------------------------------------------------
>
>                 Key: NUTCH-2341
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2341
>             Project: Nutch
>          Issue Type: Bug
>          Components: bin
>    Affects Versions: 2.3.1
>         Environment: Nutch2.3.1 + mongodb
>            Reporter: YunXia
>            Priority: Major
>             Fix For: 2.5
>
>
> I use bin/crawl to crawl url with no data returned, however use bin/nutch step by step fetch, it successed.
> {code}
> bin/nutch generate -topN 10 -crawlId nutch -batchId  "12345-123"
> bin/nutch fetch "1482737147-29630548" -crawlId nutch -threads 20 # "1482737147-29630548" is generated by 'bin/nutch geneate', here if use batchId "12345-123" as bin/crawl do, then no data returned.
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)