[jira] Created: (NUTCH-264) Tools for merging and filtering CrawlDb-s and LinkDb-s

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (NUTCH-264) Tools for merging and filtering CrawlDb-s and LinkDb-s

JIRA jira@apache.org
Tools for merging and filtering CrawlDb-s and LinkDb-s
------------------------------------------------------

         Key: NUTCH-264
         URL: http://issues.apache.org/jira/browse/NUTCH-264
     Project: Nutch
        Type: New Feature

    Versions: 0.8-dev    
    Reporter: Andrzej Bialecki
 Attachments: patch.txt

This patch contains implementations and unit tests for two new commands:

* mergedb: merges one or more CrawlDb-s, optionally filtering urls through the current URLFilters.

* mergelinkdb: as above, only for LinkDb-s. Optional filtering is applied both to toUrls and fromUrls in Inlinks.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (NUTCH-264) Tools for merging and filtering CrawlDb-s and LinkDb-s

JIRA jira@apache.org
     [ http://issues.apache.org/jira/browse/NUTCH-264?page=all ]

Andrzej Bialecki  updated NUTCH-264:
------------------------------------

    Attachment: patch.txt

> Tools for merging and filtering CrawlDb-s and LinkDb-s
> ------------------------------------------------------
>
>          Key: NUTCH-264
>          URL: http://issues.apache.org/jira/browse/NUTCH-264
>      Project: Nutch
>         Type: New Feature

>     Versions: 0.8-dev
>     Reporter: Andrzej Bialecki
>  Attachments: patch.txt
>
> This patch contains implementations and unit tests for two new commands:
> * mergedb: merges one or more CrawlDb-s, optionally filtering urls through the current URLFilters.
> * mergelinkdb: as above, only for LinkDb-s. Optional filtering is applied both to toUrls and fromUrls in Inlinks.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

Reply | Threaded
Open this post in threaded view
|

[jira] Closed: (NUTCH-264) Tools for merging and filtering CrawlDb-s and LinkDb-s

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org
     [ http://issues.apache.org/jira/browse/NUTCH-264?page=all ]
     
Andrzej Bialecki  closed NUTCH-264:
-----------------------------------

    Resolution: Fixed

A version of this patch was included in rev. 405183

> Tools for merging and filtering CrawlDb-s and LinkDb-s
> ------------------------------------------------------
>
>          Key: NUTCH-264
>          URL: http://issues.apache.org/jira/browse/NUTCH-264
>      Project: Nutch
>         Type: New Feature

>     Versions: 0.8-dev
>     Reporter: Andrzej Bialecki
>  Attachments: patch.txt
>
> This patch contains implementations and unit tests for two new commands:
> * mergedb: merges one or more CrawlDb-s, optionally filtering urls through the current URLFilters.
> * mergelinkdb: as above, only for LinkDb-s. Optional filtering is applied both to toUrls and fromUrls in Inlinks.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira