[jira] [Resolved] (NUTCH-2785) FreeGenerator: command-line option to define number of generated fetch lists

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (NUTCH-2785) FreeGenerator: command-line option to define number of generated fetch lists

Tim Allison (Jira)

     [ https://issues.apache.org/jira/browse/NUTCH-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel resolved NUTCH-2785.
------------------------------------
    Resolution: Fixed

> FreeGenerator: command-line option to define number of generated fetch lists
> ----------------------------------------------------------------------------
>
>                 Key: NUTCH-2785
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2785
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>    Affects Versions: 1.16
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Major
>             Fix For: 1.17
>
>
> While Generator allows to specify the number of generated fetch lists using the "-numFetchers" command-line option, FreeGenerator does not provide such an option. It uses the value of "mapreduce.job.maps" (2 by default), also in local mode where Generator always creates only one single fetch list.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)