[jira] [Commented] (NUTCH-2409) Injector: complete command-line help and counters

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-2409) Injector: complete command-line help and counters

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/NUTCH-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161128#comment-16161128 ]

Hudson commented on NUTCH-2409:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch-trunk #3453 (See [https://builds.apache.org/job/Nutch-trunk/3453/])
NUTCH-2409 Injector: complete command-line help and counters - add (snagel: [https://github.com/apache/nutch/commit/9b4a9df26c5b92c82029d030a9bf72cda043209c])
* (edit) src/java/org/apache/nutch/crawl/Injector.java


> Injector: complete command-line help and counters
> -------------------------------------------------
>
>                 Key: NUTCH-2409
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2409
>             Project: Nutch
>          Issue Type: Improvement
>          Components: injector
>    Affects Versions: 1.13
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Trivial
>             Fix For: 1.14
>
>
> See discussion in [NUTCH-2335|https://issues.apache.org/jira/browse/NUTCH-2335?focusedCommentId=16130178&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16130178]:
> - add counters for removed items from CrawlDb:
> {noformat}
> Injector: Total urls removed from CrawlDb by filters: 2
> Injector: Total urls with status gone removed from CrawlDb (db.update.purge.404): 0
> {noformat}
> - add {{-Ddb.update.purge.404=true}} to command-line help:
> {noformat}
> Usage: Injector [-D...] <crawldb> <url_dir> [-overwrite|-update] [-noFilter] [-noNormalize] [-filterNormalizeAll]
> ...
>  -D...          set or overwrite configuration property (property=value)
>  -Ddb.update.purge.404=true
>                 remove URLs with status gone (404) from CrawlDb
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)