[jira] Created: (NUTCH-602) Allow configurable number of handlers for search servers

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] Created: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
Allow configurable number of handlers for search servers
--------------------------------------------------------

                 Key: NUTCH-602
                 URL: https://issues.apache.org/jira/browse/NUTCH-602
             Project: Nutch
          Issue Type: Improvement
          Components: searcher
         Environment: All
            Reporter: Dennis Kubes
            Assignee: Dennis Kubes
             Fix For: 1.0.0


This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Updated: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)

     [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dennis Kubes updated NUTCH-602:
-------------------------------

    Attachment: NUTCH-602-1-20080205.patch

Changes nutch-default.xml and DistributedSearch.

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12565810#action_12565810 ]

Andrzej Bialecki  commented on NUTCH-602:
-----------------------------------------

+1

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12566772#action_12566772 ]

Dennis Kubes commented on NUTCH-602:
------------------------------------

If nobody has any objections I will commit this soon.

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12566779#action_12566779 ]

Sami Siren commented on NUTCH-602:
----------------------------------

+1

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Resolved: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

     [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dennis Kubes resolved NUTCH-602.
--------------------------------

    Resolution: Fixed

Committed.

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply | Threaded
Open this post in threaded view
|

[jira] Commented: (NUTCH-602) Allow configurable number of handlers for search servers

Sebastian Nagel (Jira)
In reply to this post by Sebastian Nagel (Jira)

    [ https://issues.apache.org/jira/browse/NUTCH-602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12566909#action_12566909 ]

Hudson commented on NUTCH-602:
------------------------------

Integrated in Nutch-trunk #355 (See [http://hudson.zones.apache.org/hudson/job/Nutch-trunk/355/])

> Allow configurable number of handlers for search servers
> --------------------------------------------------------
>
>                 Key: NUTCH-602
>                 URL: https://issues.apache.org/jira/browse/NUTCH-602
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>         Environment: All
>            Reporter: Dennis Kubes
>            Assignee: Dennis Kubes
>             Fix For: 1.0.0
>
>         Attachments: NUTCH-602-1-20080205.patch
>
>
> This improvement changes the distributed search server to allow a configurable number of RPC handlers.  Before the number was hardcoded at 10 handlers.  For high volume environments that limit will be quickly reached and the overall search will slowdown.  The patch changes nutch-default.xml with the configuration parameter searchers.num.handlers and changes DistributedSearch to pull the number of handlers from the configuration.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.