[jira] [Commented] (NUTCH-1559) parse-metatags duplicates extracted metatags

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

[jira] [Commented] (NUTCH-1559) parse-metatags duplicates extracted metatags

Tim Allison (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969056#comment-16969056 ]

Hudson commented on NUTCH-1559:

SUCCESS: Integrated in Jenkins build Nutch-trunk #3652 (See [https://builds.apache.org/job/Nutch-trunk/3652/])
NUTCH-1559 parse-metatags duplicates extracted metatags - do not add (snagel: [https://github.com/apache/nutch/commit/497936b37751f6716da372611bf34d777b88d14d])
* (edit) src/plugin/parse-metatags/src/java/org/apache/nutch/parse/metatags/MetaTagsParser.java
* (edit) src/plugin/parse-metatags/src/test/org/apache/nutch/parse/metatags/TestMetatagParser.java

> parse-metatags duplicates extracted metatags
> --------------------------------------------
>                 Key: NUTCH-1559
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1559
>             Project: Nutch
>          Issue Type: Bug
>          Components: parser, plugin
>    Affects Versions: 1.6
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.17
>         Attachments: NUTCH-1559-1.x.patch
> If the plugin parse-metatags is used in combination with parse-tika, the extracted metatags (the pairs <name, value>) are duplicated.
> The metatags are found twice in parse.getData().getParseMeta() and in metaTags.getGeneralTags(). Is this necessary? Maybe we should fix parse-tika in this point?

This message was sent by Atlassian Jira