[jira] [Commented] (NUTCH-1559) parse-metatags duplicates extracted metatags

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-1559) parse-metatags duplicates extracted metatags

Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-1559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953794#comment-16953794 ]

ASF GitHub Bot commented on NUTCH-1559:
---------------------------------------

sebastian-nagel commented on pull request #481: NUTCH-1559 parse-metatags duplicates extracted metatags
URL: https://github.com/apache/nutch/pull/481
 
 
   - do not add metatags already in ParseData's as this may lead to duplicates
   - add unit test
   - fix logging in MetaTagsParser to use slf4j
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


> parse-metatags duplicates extracted metatags
> --------------------------------------------
>
>                 Key: NUTCH-1559
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1559
>             Project: Nutch
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 1.6
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.17
>
>         Attachments: NUTCH-1559-1.x.patch
>
>
> If the plugin parse-metatags is used in combination with parse-tika, the extracted metatags (the pairs <name, value>) are duplicated.
> The metatags are found twice in parse.getData().getParseMeta() and in metaTags.getGeneralTags(). Is this necessary? Maybe we should fix parse-tika in this point?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)