[jira] [Created] (NUTCH-2618) protocol-okhttp not to use http.timeout for max duration to fetch document

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (NUTCH-2618) protocol-okhttp not to use http.timeout for max duration to fetch document

JIRA jira@apache.org
Sebastian Nagel created NUTCH-2618:
--------------------------------------

             Summary: protocol-okhttp not to use http.timeout for max duration to fetch document
                 Key: NUTCH-2618
                 URL: https://issues.apache.org/jira/browse/NUTCH-2618
             Project: Nutch
          Issue Type: Bug
          Components: protocol
    Affects Versions: 1.15
            Reporter: Sebastian Nagel
             Fix For: 1.15


Protocol-okhttp (NUTCH-2576) uses the HTTP network timeout ({{http.timeout}}) as time limit for the max duration to fetch a document. The timeout value (default = 10 sec.) is usually to small to fetch larger documents. The max fetch duration should be separately configurable, e.g., by a property {{http.time.limit}} (similar to {{http.content.limit}}).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)