Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

Vrushali Channapattan
Looks like some of the hyperlinks appear messed up, my apologies, resending
the same email with hopefully better looking content:

Hi All,

I'd like to open a discussion for merging Timeline Service v2 (YARN-5355)
to trunk in a few weeks.

We have previously completed one merge onto trunk [1] and Timeline Service
v2 has been part of Hadoop release 3.0.0-alpha1.

Since then, we have been working on extending the capabilities of Timeline
Service v2 in a feature branch [2].  There are a few related issues pending
that are being actively worked upon and tested. As soon as they are
resolved, we plan on starting a merge vote within the next two weeks. The
goal is to get this into hadoop3 beta.

We have paid close attention to ensure that  once disabled Timeline Service
v2 does not impact existing functionality when disabled (by default).

At a high level, following are the key features that have been implemented
since 3.0.0-alpha1:
- Security (via Kerberos Authentication & delegation tokens) [YARN-3053]
- Timeline server usability improvements [timeline-server
<https://issues.apache.org/jira/browse/YARN-5715?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20%3D%20timelineserver%20AND%20labels%20!%3D%20atsv2-hbase%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC>
]
- HBase specific improvements [atsv2-hbase
<https://issues.apache.org/jira/browse/YARN-6604?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20labels%20%3D%20atsv2-hbase%20ORDER%20BY%20updated%20DESC%2C%20affectedVersion%20DESC%2C%20priority%20DESC%2C%20created%20ASC>
]
- REST API additions and improvements [timeline-reader
<https://issues.apache.org/jira/browse/YARN-5739?jql=project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-5355%20AND%20component%20in%20(timelineclient%2C%20timelinereader)%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%20created%20ASC>
]
- Reader side simple authorization via whitelist [YARN-6820]

We would love to get your thoughts on this before we open a real voting
thread.

Special thanks to a team of folks who worked hard and contributed towards
this effort via patches, reviews and guidance: Rohith Sharma K S, Varun
Saxena, Haibo Chen, Sangjin Lee, Li Lu, Vinod Kumar Vavilapalli, Joep
Rottinghuis, Jason Lowe, Jian He, Robert Kanter, Micheal Stack.

Thanks
Vrushali
[1] Merge to trunk: http://www.mail-archive.com/yarn-dev@....
org/msg23897.html
[2] feature branch YARN-5355 commits: https://github.com/ap
ache/hadoop/commits/YARN-5355
<https://github.com/apache/hadoop/commits/YARN-5355>






On Wed, Aug 16, 2017 at 10:02 AM, Vrushali Channapattan <
[hidden email]> wrote:

> Hi All
>
> I’d like to open a discussion for merging Timeline Service v.2 (YARN-5355)
> to trunk in a few weeks.
>
> We have previously completed one merge onto trunk [1] and Timeline Service
> v2 has been part of Hadoop release 3.0.0-alpha1.
>
> Since then, we have been working on extending the capabilities of Timeline
> Service v2 in a feature branch [2]. There are a few related issues pending
> that are being actively worked upon & tested. As soon as they are resolved,
> we plan on starting a merge vote within the next 2 weeks. The goal is to
> get this in for Hadoop3 beta.
>
> We have paid close attention to ensure that once disabled Timeline Service
> v.2 does not impact existing functionality when disabled (by default).
>
> At a high level, following are the key features that have been implemented
> since 3.0.0-alpha1:
> - Security (via Kerberos Authentication & delegation tokens) at the writer
> [YARN-3053]
> - Timeline server usability improvements [timeline-server
> <https://issues.apache.org/jira/browse/YARN-5715?jql=
> project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-
> 5355%20AND%20component%20%3D%20timelineserver%20AND%
> 20labels%20%21%3D%20atsv2-hbase%20ORDER%20BY%20updated%
> 20ASC%2C%20priority%20DESC%2C%20created%20ASC>
> ]
> - HBase specific improvements [atsv2-hbase
> <https://issues.apache.org/jira/browse/YARN-6604?jql=
> project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-
> 5355%20AND%20labels%20%3D%20atsv2-hbase%20ORDER%20BY%20updated%20DESC%2C%
> 20affectedVersion%20DESC%2C%20priority%20DESC%2C%20created%20ASC>
> ]
> - REST API additions & improvements [timeline-reader
> <https://issues.apache.org/jira/browse/YARN-5739?jql=
> project%20%3D%20YARN%20AND%20fixVersion%20%3D%20YARN-
> 5355%20AND%20component%20in%20%28timelineclient%2C%
> 20timelinereader%29%20ORDER%20BY%20updated%20ASC%2C%20priority%20DESC%2C%
> 20created%20ASC>
> ]
> - Reader side simple authorization via whitelist [YARN-6820]
>
> We would love to get your thoughts on these and more before we open a real
> voting thread.
>
> Special thanks to a team of folks who worked hard and contributed towards
> this effort with patches, reviews and guidance: Rohith Sharma K S, Varun
> Saxena, Haibo Chen, Sangjin Lee, Li Lu, Vinod Kumar Vavilapalli, Joep
> Rottinghuis, Jason Lowe, Jian He, Robert Kanter, Micheal Stack.
>
> Thanks!
> Vrushali
>
> [1] Merge to trunk: http://www.mail-archive.com/yarn-dev@hadoop.
> apache.org/msg23897.html
> [2] feature branch YARN-5355 commits: https://github.com/
> apache/hadoop/commits/YARN-5355
>