[jira] [Commented] (NUTCH-2472) Sitemap processor does not honour db.ignore.external.links

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-2472) Sitemap processor does not honour db.ignore.external.links

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/NUTCH-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280155#comment-16280155 ]

Sebastian Nagel commented on NUTCH-2472:
----------------------------------------

Hi [~markus17], could you give an example? The sitemaps protocol clearly specifies what URLs are allowed (see [location|https://www.sitemaps.org/protocol.html#location] and [crawler-commons#85|https://github.com/crawler-commons/crawler-commons/issues/85]), shouldn't this take precedence before Nutch-internal settings how links in general are followed?

> Sitemap processor does not honour db.ignore.external.links
> ----------------------------------------------------------
>
>                 Key: NUTCH-2472
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2472
>             Project: Nutch
>          Issue Type: Bug
>          Components: sitemap
>    Affects Versions: 1.13
>            Reporter: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.14
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)