[jira] [Created] (HADOOP-14193) Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Created] (HADOOP-14193) Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost

JIRA jira@apache.org
Jose Miguel Arreola created HADOOP-14193:
--------------------------------------------

             Summary: Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost
                 Key: HADOOP-14193
                 URL: https://issues.apache.org/jira/browse/HADOOP-14193
             Project: Hadoop Common
          Issue Type: Improvement
          Components: common
            Reporter: Jose Miguel Arreola


When running performance tests, we noticed that a lot of time is taken in resolving the host address.
In our specific scenario, we saw the function org.apache.hadoop.security.SecurityUtil.getInetAddressByName taking a lot of time to resolve the hosts, and the same function is called a lot of times.
I saw that org.apache.hadoop.yarn.server.resourcemanager.NodesListManager has a cached resolver already because of the same reason.
So, the proposal is, to make this cache generic and use it to save some time in this functions that we already know, but have it available so the cache can be used anywhere else.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Loading...