[jira] [Commented] (NUTCH-1194) Generator: CrawlDB lock should be released earlier

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (NUTCH-1194) Generator: CrawlDB lock should be released earlier

Tim Allison (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099852#comment-17099852 ]

Hudson commented on NUTCH-1194:
-------------------------------

SUCCESS: Integrated in Jenkins build Nutch-trunk #3680 (See [https://builds.apache.org/job/Nutch-trunk/3680/])
NUTCH-1194 Generator: CrawlDB lock should be released earlier - release (snagel: [https://github.com/apache/nutch/commit/11eea5aea89599e2c35e577d15623f1278ded8e4])
* (edit) src/java/org/apache/nutch/util/NutchJob.java
* (edit) src/java/org/apache/nutch/crawl/Generator.java


> Generator: CrawlDB lock should be released earlier
> --------------------------------------------------
>
>                 Key: NUTCH-1194
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1194
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>            Priority: Minor
>             Fix For: 1.17
>
>
> Lock on the CrawlDB is released when everything is finished. But when generating many segments, the lock remains in place while it's not neccessary anymore. If GENERATE_UPDATE_DB is false we can release the lock immediately after the selector has finished.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)