[jira] [Commented] (NUTCH-1741) Support of Sitemaps in Nutch 2.x

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-1741) Support of Sitemaps in Nutch 2.x

Akash (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018330#comment-17018330 ]

ASF GitHub Bot commented on NUTCH-1741:
---------------------------------------

sebastian-nagel commented on issue #304: NUTCH-1741 sitemaps argument for generate, fetch, and parse, takes te…
URL: https://github.com/apache/nutch/pull/304#issuecomment-575801837
 
 
   NUTCH-1741 has been implemented in ffa04e1. This PR adds the option to control what is fetched in a batch - only sitemaps, only "ordinary" web pages, or both.
   
   We had to retire the development on the 2.x branch after the release of 2.4 as no committers are actively working on it. Sorry about this. But thanks for your contribution, @benmvachon! I'll go through PRs and close the ones for 2.x which have been left open.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


> Support of Sitemaps in Nutch 2.x
> --------------------------------
>
>                 Key: NUTCH-1741
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1741
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, generator
>            Reporter: Alparslan Avcı
>            Assignee: Cihad Guzel
>            Priority: Major
>              Labels: gsoc2015
>             Fix For: 2.4
>
>         Attachments: NUTCH-1741-v2.patch, NUTCH-1741-v3.patch, NUTCH-1741-v4.patch, NUTCH-1741-webpage-avsc.patch, NUTCH-1741.patch, NUTCH-1741v5.patch, NUTCH-1741v6.patch, NUTCH-1741v7.patch, SitemapCrawlerLifeCycle.pdf, SitemapDevelopmentFor2x.pdf
>
>
> Sitemap support has to be implemented for 2.x branch. It is being discussed in NUTCH-1465 for trunk.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)