[jira] [Commented] (NUTCH-1129) Any23 Nutch plugin

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-1129) Any23 Nutch plugin

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/NUTCH-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16320750#comment-16320750 ]

ASF GitHub Bot commented on NUTCH-1129:
---------------------------------------

mfeltscher commented on a change in pull request #205: WIP: NUTCH-1129 microdata for Nutch 1.x
URL: https://github.com/apache/nutch/pull/205#discussion_r160756114
 
 

 ##########
 File path: src/bin/crawl
 ##########
 @@ -15,26 +15,32 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
-# Usage: crawl [-i|--index] [-D "key=value"] [-w|--wait] [-s <SeedDir>] [-sm <SitemapDir>] <CrawlDir> <NumRounds>
-#    -i|--index      Indexes crawl results into a configured indexer
-#    -w|--wait       NUMBER[SUFFIX] Time to wait before generating a new segment when no URLs
-#                    are scheduled for fetching. Suffix can be: s for second,
-#                    m for minute, h for hour and d for day. If no suffix is
-#                    specified second is used by default.
-#    -D              A Java property to pass to Nutch calls
-#    -s              Path to seeds file(s)
-#    -sm             Path to sitemap URL file(s)
-#    CrawlDir        Directory where the crawl/link/segments dirs are saved
-#    NumRounds       The number of rounds to run this crawl for
+# Usage: crawl [options] <crawl_dir> <num_rounds>
 
 Review comment:
   @lewismc I went ahead and merged master back into this feature branch so this is solved - see 1e2c84882b9d218c88752a93c4adaf167ae9355d

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


> Any23 Nutch plugin
> ------------------
>
>                 Key: NUTCH-1129
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1129
>             Project: Nutch
>          Issue Type: New Feature
>          Components: parser
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 2.5
>
>         Attachments: NUTCH-1129.patch
>
>
> This plugin should build on the Any23 library to provide us with a plugin which extracts RDF data from HTTP and file resources. Although as of writing Any23 not part of the ASF, the project is working towards integration into the Apache Incubator. Once the project proves its value, this would be an excellent addition to the Nutch 1.X codebase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)