[VOTE] Release Apache Hadoop 2.10.1 (RC0)

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

[VOTE] Release Apache Hadoop 2.10.1 (RC0)

Masatake Iwasaki
Hi folks,

This is the first release candidate for the second release of Apache Hadoop 2.10.
It contains 218 fixes/improvements since 2.10.0 [1].

The RC0 artifacts are at:
http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/

RC tag is release-2.10.1-RC0:
https://github.com/apache/hadoop/tree/release-2.10.1-RC0

The maven artifacts are hosted here:
https://repository.apache.org/content/repositories/orgapachehadoop-1279/

My public key is available here:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS

The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.

[1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1

Thanks,
Masatake Iwasaki

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [E] [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Jim Brennan
Thanks for your work on this Masatake!  I am +1 (non-binding) on this
2.10.1 release.
I built from source and ran hdfs, resourcemanager, and nodemanager unit
tests.
I set up a one-node-cluster and ran some example jobs (pi, sleep).
I tested NM/RM recovery by killing NM/RM during jobs and verifying they
completed successfully after restarting them.

On Mon, Sep 14, 2020 at 12:59 PM Masatake Iwasaki <
[hidden email]> wrote:

> Hi folks,
>
> This is the first release candidate for the second release of Apache
> Hadoop 2.10.
> It contains 218 fixes/improvements since 2.10.0 [1].
>
> The RC0 artifacts are at:
>
> https://urldefense.com/v3/__http://home.apache.org/*iwasakims/hadoop-2.10.1-RC0/__;fg!!Op6eflyXZCqGR5I!SffKK-HwJYiYKe2rYhl5ajTjL20w4JKLTHjt3MeLb7WjTV7hbhiFFlECw5DPzXq4v4K_eE4$
>
> RC tag is release-2.10.1-RC0:
>
> https://urldefense.com/v3/__https://github.com/apache/hadoop/tree/release-2.10.1-RC0__;!!Op6eflyXZCqGR5I!SffKK-HwJYiYKe2rYhl5ajTjL20w4JKLTHjt3MeLb7WjTV7hbhiFFlECw5DPzXq4x2Dtalw$
>
> The maven artifacts are hosted here:
>
> https://urldefense.com/v3/__https://repository.apache.org/content/repositories/orgapachehadoop-1279/__;!!Op6eflyXZCqGR5I!SffKK-HwJYiYKe2rYhl5ajTjL20w4JKLTHjt3MeLb7WjTV7hbhiFFlECw5DPzXq4i6I2aus$
>
> My public key is available here:
>
> https://urldefense.com/v3/__https://dist.apache.org/repos/dist/release/hadoop/common/KEYS__;!!Op6eflyXZCqGR5I!SffKK-HwJYiYKe2rYhl5ajTjL20w4JKLTHjt3MeLb7WjTV7hbhiFFlECw5DPzXq4cgWpFYE$
>
> The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.
>
> [1]
> https://urldefense.com/v3/__https://issues.apache.org/jira/issues/?jql=project*20in*20(HDFS*2C*20YARN*2C*20HADOOP*2C*20MAPREDUCE)*20AND*20resolution*20*3D*20Fixed*20AND*20fixVersion*20*3D*202.10.1__;JSUlJSUlJSUlJSUlJSUlJSUl!!Op6eflyXZCqGR5I!SffKK-HwJYiYKe2rYhl5ajTjL20w4JKLTHjt3MeLb7WjTV7hbhiFFlECw5DPzXq4Q9b1yE4$
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Masatake Iwasaki
In reply to this post by Masatake Iwasaki
+1(binding) from myself.

* launched pseudo-distributed cluster using binary tarball on CentOS 7.
* ran some example mapreduce jobs.

* built source tarball on CentOS 8 with `-Pdist -Pnative`.
* launched 3-nodes cluster with NN-HA and RM-HA enabled using docker.
* ran some example mapreduce jobs.

* built RPM from source tarball using master branch of Bigtop on CentOS 7.
* deployed 3-nodes cluster using docker provisioner of Bigtop.
* ran smoke-tests of hdfs, yarn, mapreduce and kms.

* built RPM of hbase-1.5.0 and hive-2.3.6 using master branch of Bigtop on CentOS 7.
   
Thanks,
Masatake Iwasaki

On 2020/09/15 2:59, Masatake Iwasaki wrote:

> Hi folks,
>
> This is the first release candidate for the second release of Apache Hadoop 2.10.
> It contains 218 fixes/improvements since 2.10.0 [1].
>
> The RC0 artifacts are at:
> http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
>
> RC tag is release-2.10.1-RC0:
> https://github.com/apache/hadoop/tree/release-2.10.1-RC0
>
> The maven artifacts are hosted here:
> https://repository.apache.org/content/repositories/orgapachehadoop-1279/
>
> My public key is available here:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.
>
> [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Eric Payne-3
In reply to this post by Masatake Iwasaki
Masatake,

Thank you for the good work on creating this release!

+1

I downloaded and built the source. I ran a one-node cluster with 6 NMs.
I manually ran apps in the Capacity Scheduler to test labels and capacity assignments.

-Eric


On Monday, September 14, 2020, 12:59:17 PM CDT, Masatake Iwasaki <[hidden email]> wrote:

Hi folks,

This is the first release candidate for the second release of Apache Hadoop 2.10.
It contains 218 fixes/improvements since 2.10.0 [1].

The RC0 artifacts are at:
http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/

RC tag is release-2.10.1-RC0:
https://github.com/apache/hadoop/tree/release-2.10.1-RC0

The maven artifacts are hosted here:
https://repository.apache.org/content/repositories/orgapachehadoop-1279/

My public key is available here:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS

The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.

[1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1

Thanks,
Masatake Iwasaki

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [E] Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Eric Badger-2
+1 (non-binding)

- Verified all hashes and checksums
- Built from source on RHEL 7
- Deployed a single node pseudo cluster
- Ran some example jobs

Only minor thing is that the DockerLinuxContainerRuntime won't run in a
secure environment using kerberos and nscd because there is no way to
bind-mount the nscd socket without modifying the source code. However,
DockerLinuxContainerRuntime is wholly experimental in 2.10 and anyone using
it should be on 3.x

Eric

On Fri, Sep 18, 2020 at 3:21 PM Eric Payne <[hidden email]>
wrote:

> Masatake,
>
> Thank you for the good work on creating this release!
>
> +1
>
> I downloaded and built the source. I ran a one-node cluster with 6 NMs.
> I manually ran apps in the Capacity Scheduler to test labels and capacity
> assignments.
>
> -Eric
>
>
> On Monday, September 14, 2020, 12:59:17 PM CDT, Masatake Iwasaki <
> [hidden email]> wrote:
>
> Hi folks,
>
> This is the first release candidate for the second release of Apache
> Hadoop 2.10.
> It contains 218 fixes/improvements since 2.10.0 [1].
>
> The RC0 artifacts are at:
>
> https://urldefense.com/v3/__http://home.apache.org/*iwasakims/hadoop-2.10.1-RC0/__;fg!!Op6eflyXZCqGR5I!QTDqxdNdFvwVpf8N82qVDnPyt1z8aPY6V3dtkcE3Pkxk3iR0SPKio96j4FMZ$
>
> RC tag is release-2.10.1-RC0:
>
> https://urldefense.com/v3/__https://github.com/apache/hadoop/tree/release-2.10.1-RC0__;!!Op6eflyXZCqGR5I!QTDqxdNdFvwVpf8N82qVDnPyt1z8aPY6V3dtkcE3Pkxk3iR0SPKio254keyy$
>
> The maven artifacts are hosted here:
>
> https://urldefense.com/v3/__https://repository.apache.org/content/repositories/orgapachehadoop-1279/__;!!Op6eflyXZCqGR5I!QTDqxdNdFvwVpf8N82qVDnPyt1z8aPY6V3dtkcE3Pkxk3iR0SPKioxzi9JE1$
>
> My public key is available here:
>
> https://urldefense.com/v3/__https://dist.apache.org/repos/dist/release/hadoop/common/KEYS__;!!Op6eflyXZCqGR5I!QTDqxdNdFvwVpf8N82qVDnPyt1z8aPY6V3dtkcE3Pkxk3iR0SPKioz0s1m6i$
>
> The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.
>
> [1]
> https://urldefense.com/v3/__https://issues.apache.org/jira/issues/?jql=project*20in*20(HDFS*2C*20YARN*2C*20HADOOP*2C*20MAPREDUCE)*20AND*20resolution*20*3D*20Fixed*20AND*20fixVersion*20*3D*202.10.1__;JSUlJSUlJSUlJSUlJSUlJSUl!!Op6eflyXZCqGR5I!QTDqxdNdFvwVpf8N82qVDnPyt1z8aPY6V3dtkcE3Pkxk3iR0SPKiox7cDnhJ$
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Masatake Iwasaki
In reply to this post by Masatake Iwasaki
The RC0 got 2 binding +1's and 2 non-binging +1's [1].

Based on the discussion about release vote [2],
bylaws[3] defines the periods in minimum terms.
We can extend it if there is not enough activity.

I would like to extend the period to 7 days,
until Monday September 21 at 10:00 am PDT.

I will appreciate additional votes.

Thanks,
Masatake Iwasaki

[1] https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
[2] https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
[3] https://hadoop.apache.org/bylaws.html

On 2020/09/15 2:59, Masatake Iwasaki wrote:

> Hi folks,
>
> This is the first release candidate for the second release of Apache Hadoop 2.10.
> It contains 218 fixes/improvements since 2.10.0 [1].
>
> The RC0 artifacts are at:
> http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
>
> RC tag is release-2.10.1-RC0:
> https://github.com/apache/hadoop/tree/release-2.10.1-RC0
>
> The maven artifacts are hosted here:
> https://repository.apache.org/content/repositories/orgapachehadoop-1279/
>
> My public key is available here:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.
>
> [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Sunil Govindan
+1 (binding)

- verified checksum and sign. Shows as a Good signature from "Masatake
Iwasaki (CODE SIGNING KEY) <[hidden email]>"
- built from source
- ran basic MR job and looks good
- UI also seems fine

Thanks,
Sunil

On Sun, Sep 20, 2020 at 11:38 AM Masatake Iwasaki <
[hidden email]> wrote:

> The RC0 got 2 binding +1's and 2 non-binging +1's [1].
>
> Based on the discussion about release vote [2],
> bylaws[3] defines the periods in minimum terms.
> We can extend it if there is not enough activity.
>
> I would like to extend the period to 7 days,
> until Monday September 21 at 10:00 am PDT.
>
> I will appreciate additional votes.
>
> Thanks,
> Masatake Iwasaki
>
> [1]
> https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
> [2]
> https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
> [3] https://hadoop.apache.org/bylaws.html
>
> On 2020/09/15 2:59, Masatake Iwasaki wrote:
> > Hi folks,
> >
> > This is the first release candidate for the second release of Apache
> Hadoop 2.10.
> > It contains 218 fixes/improvements since 2.10.0 [1].
> >
> > The RC0 artifacts are at:
> > http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
> >
> > RC tag is release-2.10.1-RC0:
> > https://github.com/apache/hadoop/tree/release-2.10.1-RC0
> >
> > The maven artifacts are hosted here:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1279/
> >
> > My public key is available here:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The vote will run for 5 days, until Saturday, September 19 at 10:00 am
> PDT.
> >
> > [1]
> https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [hidden email]
> > For additional commands, e-mail: [hidden email]
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Wei-Chiu Chuang-2
+1 (binding)

I did a security scan for the 2.10.1 RC0 and it looks fine to me.

Checked recent critical/blocker HDFS issues that are not in 2.10.1. It
looks mostly fine. Most of them are Hadoop 3.x features (EC, ... etc) but
there is one worth attention:


   1. HDFS-14674 <https://issues.apache.org/jira/browse/HDFS-14674> [SBN
   read] Got an unexpected txid when tail editlog.
   2.
      1. But looking at the jira, it doesn't apply to 2.x so I think we are
      good there.
      2.
      3.
      4. I wanted to do an API compat check but didn't finish it yet. If
      someone can do it quickly that would be great. (Does anyone know
of a cloud
      service that we can quickly do a Java API compat check?)

Cheers,
Wei-Chiu

On Sun, Sep 20, 2020 at 9:25 AM Sunil Govindan <[hidden email]> wrote:

> +1 (binding)
>
> - verified checksum and sign. Shows as a Good signature from "Masatake
> Iwasaki (CODE SIGNING KEY) <[hidden email]>"
> - built from source
> - ran basic MR job and looks good
> - UI also seems fine
>
> Thanks,
> Sunil
>
> On Sun, Sep 20, 2020 at 11:38 AM Masatake Iwasaki <
> [hidden email]> wrote:
>
> > The RC0 got 2 binding +1's and 2 non-binging +1's [1].
> >
> > Based on the discussion about release vote [2],
> > bylaws[3] defines the periods in minimum terms.
> > We can extend it if there is not enough activity.
> >
> > I would like to extend the period to 7 days,
> > until Monday September 21 at 10:00 am PDT.
> >
> > I will appreciate additional votes.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > [1]
> >
> https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
> > [2]
> >
> https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
> > [3] https://hadoop.apache.org/bylaws.html
> >
> > On 2020/09/15 2:59, Masatake Iwasaki wrote:
> > > Hi folks,
> > >
> > > This is the first release candidate for the second release of Apache
> > Hadoop 2.10.
> > > It contains 218 fixes/improvements since 2.10.0 [1].
> > >
> > > The RC0 artifacts are at:
> > > http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
> > >
> > > RC tag is release-2.10.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-2.10.1-RC0
> > >
> > > The maven artifacts are hosted here:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1279/
> > >
> > > My public key is available here:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The vote will run for 5 days, until Saturday, September 19 at 10:00 am
> > PDT.
> > >
> > > [1]
> >
> https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
> > >
> > > Thanks,
> > > Masatake Iwasaki
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: [hidden email]
> > > For additional commands, e-mail: [hidden email]
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [hidden email]
> > For additional commands, e-mail: [hidden email]
> >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Vinayakumar B-3
Apologies for delayed voting.

+1 (Binding)

1. Verified the signature. Signatures are good.
2. Verified the sha512 checksum
           (I tried to use the sha512sum tool to verify. But ".sha512"
files doesn't have the expected format. I guess these files are regenerated
using "gpg --print-md", not the one used by createrelease scripts,
'sha512sum --tag'. It would be easy to verify using tool if the .sha512
have the proper format)
3. src tar have the "patchprocess" directory, may be need to backport the
fix in trunk to branch-2.10 to avoid this in future.
4. Deployed 3 node docker cluster and ran basic jobs. All-Ok.

-Vinay


On Mon, Sep 21, 2020 at 5:24 AM Wei-Chiu Chuang <[hidden email]> wrote:

> +1 (binding)
>
> I did a security scan for the 2.10.1 RC0 and it looks fine to me.
>
> Checked recent critical/blocker HDFS issues that are not in 2.10.1. It
> looks mostly fine. Most of them are Hadoop 3.x features (EC, ... etc) but
> there is one worth attention:
>
>
>    1. HDFS-14674 <https://issues.apache.org/jira/browse/HDFS-14674> [SBN
>    read] Got an unexpected txid when tail editlog.
>    2.
>       1. But looking at the jira, it doesn't apply to 2.x so I think we are
>       good there.
>       2.
>       3.
>       4. I wanted to do an API compat check but didn't finish it yet. If
>       someone can do it quickly that would be great. (Does anyone know
> of a cloud
>       service that we can quickly do a Java API compat check?)
>
> Cheers,
> Wei-Chiu
>
> On Sun, Sep 20, 2020 at 9:25 AM Sunil Govindan <[hidden email]> wrote:
>
> > +1 (binding)
> >
> > - verified checksum and sign. Shows as a Good signature from "Masatake
> > Iwasaki (CODE SIGNING KEY) <[hidden email]>"
> > - built from source
> > - ran basic MR job and looks good
> > - UI also seems fine
> >
> > Thanks,
> > Sunil
> >
> > On Sun, Sep 20, 2020 at 11:38 AM Masatake Iwasaki <
> > [hidden email]> wrote:
> >
> > > The RC0 got 2 binding +1's and 2 non-binging +1's [1].
> > >
> > > Based on the discussion about release vote [2],
> > > bylaws[3] defines the periods in minimum terms.
> > > We can extend it if there is not enough activity.
> > >
> > > I would like to extend the period to 7 days,
> > > until Monday September 21 at 10:00 am PDT.
> > >
> > > I will appreciate additional votes.
> > >
> > > Thanks,
> > > Masatake Iwasaki
> > >
> > > [1]
> > >
> >
> https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
> > > [2]
> > >
> >
> https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
> > > [3] https://hadoop.apache.org/bylaws.html
> > >
> > > On 2020/09/15 2:59, Masatake Iwasaki wrote:
> > > > Hi folks,
> > > >
> > > > This is the first release candidate for the second release of Apache
> > > Hadoop 2.10.
> > > > It contains 218 fixes/improvements since 2.10.0 [1].
> > > >
> > > > The RC0 artifacts are at:
> > > > http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
> > > >
> > > > RC tag is release-2.10.1-RC0:
> > > > https://github.com/apache/hadoop/tree/release-2.10.1-RC0
> > > >
> > > > The maven artifacts are hosted here:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1279/
> > > >
> > > > My public key is available here:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The vote will run for 5 days, until Saturday, September 19 at 10:00
> am
> > > PDT.
> > > >
> > > > [1]
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
> > > >
> > > > Thanks,
> > > > Masatake Iwasaki
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: [hidden email]
> > > > For additional commands, e-mail: [hidden email]
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: [hidden email]
> > > For additional commands, e-mail: [hidden email]
> > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Mingliang Liu-3
+1 (binding)

1. Download binary and check signature / checksum successfully
2. Create a 3 node cluster in Docker containers and start the HDFS/YARN
services
3. Verify the running version
4. Run simple HDFS/YARN client/admin commands and verify the output
5. Run example programs wordcount and grep
6. Check NN/DN/RM status and service logs

Thanks,

On Mon, Sep 21, 2020 at 12:34 AM Vinayakumar B <[hidden email]>
wrote:

> Apologies for delayed voting.
>
> +1 (Binding)
>
> 1. Verified the signature. Signatures are good.
> 2. Verified the sha512 checksum
>            (I tried to use the sha512sum tool to verify. But ".sha512"
> files doesn't have the expected format. I guess these files are regenerated
> using "gpg --print-md", not the one used by createrelease scripts,
> 'sha512sum --tag'. It would be easy to verify using tool if the .sha512
> have the proper format)
> 3. src tar have the "patchprocess" directory, may be need to backport the
> fix in trunk to branch-2.10 to avoid this in future.
> 4. Deployed 3 node docker cluster and ran basic jobs. All-Ok.
>
> -Vinay
>
>
> On Mon, Sep 21, 2020 at 5:24 AM Wei-Chiu Chuang <[hidden email]>
> wrote:
>
> > +1 (binding)
> >
> > I did a security scan for the 2.10.1 RC0 and it looks fine to me.
> >
> > Checked recent critical/blocker HDFS issues that are not in 2.10.1. It
> > looks mostly fine. Most of them are Hadoop 3.x features (EC, ... etc) but
> > there is one worth attention:
> >
> >
> >    1. HDFS-14674 <https://issues.apache.org/jira/browse/HDFS-14674> [SBN
> >    read] Got an unexpected txid when tail editlog.
> >    2.
> >       1. But looking at the jira, it doesn't apply to 2.x so I think we
> are
> >       good there.
> >       2.
> >       3.
> >       4. I wanted to do an API compat check but didn't finish it yet. If
> >       someone can do it quickly that would be great. (Does anyone know
> > of a cloud
> >       service that we can quickly do a Java API compat check?)
> >
> > Cheers,
> > Wei-Chiu
> >
> > On Sun, Sep 20, 2020 at 9:25 AM Sunil Govindan <[hidden email]>
> wrote:
> >
> > > +1 (binding)
> > >
> > > - verified checksum and sign. Shows as a Good signature from "Masatake
> > > Iwasaki (CODE SIGNING KEY) <[hidden email]>"
> > > - built from source
> > > - ran basic MR job and looks good
> > > - UI also seems fine
> > >
> > > Thanks,
> > > Sunil
> > >
> > > On Sun, Sep 20, 2020 at 11:38 AM Masatake Iwasaki <
> > > [hidden email]> wrote:
> > >
> > > > The RC0 got 2 binding +1's and 2 non-binging +1's [1].
> > > >
> > > > Based on the discussion about release vote [2],
> > > > bylaws[3] defines the periods in minimum terms.
> > > > We can extend it if there is not enough activity.
> > > >
> > > > I would like to extend the period to 7 days,
> > > > until Monday September 21 at 10:00 am PDT.
> > > >
> > > > I will appreciate additional votes.
> > > >
> > > > Thanks,
> > > > Masatake Iwasaki
> > > >
> > > > [1]
> > > >
> > >
> >
> https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
> > > > [2]
> > > >
> > >
> >
> https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
> > > > [3] https://hadoop.apache.org/bylaws.html
> > > >
> > > > On 2020/09/15 2:59, Masatake Iwasaki wrote:
> > > > > Hi folks,
> > > > >
> > > > > This is the first release candidate for the second release of
> Apache
> > > > Hadoop 2.10.
> > > > > It contains 218 fixes/improvements since 2.10.0 [1].
> > > > >
> > > > > The RC0 artifacts are at:
> > > > > http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
> > > > >
> > > > > RC tag is release-2.10.1-RC0:
> > > > > https://github.com/apache/hadoop/tree/release-2.10.1-RC0
> > > > >
> > > > > The maven artifacts are hosted here:
> > > > >
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1279/
> > > > >
> > > > > My public key is available here:
> > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > >
> > > > > The vote will run for 5 days, until Saturday, September 19 at 10:00
> > am
> > > > PDT.
> > > > >
> > > > > [1]
> > > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
> > > > >
> > > > > Thanks,
> > > > > Masatake Iwasaki
> > > > >
> > > > >
> ---------------------------------------------------------------------
> > > > > To unsubscribe, e-mail: [hidden email]
> > > > > For additional commands, e-mail: [hidden email]
> > > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: [hidden email]
> > > > For additional commands, e-mail:
> [hidden email]
> > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Masatake Iwasaki
In reply to this post by Masatake Iwasaki
The vote passed with 6 binging +1's and 2 non-binding +1's.
Thanks all for pushing this.
I'm going to publish the release.

binding +1's:

- Eric Payne
- Sunil Govindan
- Wei-Chiu Chuang
- Vinayakumar B
- Mingliang Liu
- Masatake Iwasaki

non-binding +1's:

- Jim Brennan
- Eric Badger

Bests,
Masatake Iwasaki

On 2020/09/20 15:07, Masatake Iwasaki wrote:

> The RC0 got 2 binding +1's and 2 non-binging +1's [1].
>
> Based on the discussion about release vote [2],
> bylaws[3] defines the periods in minimum terms.
> We can extend it if there is not enough activity.
>
> I would like to extend the period to 7 days,
> until Monday September 21 at 10:00 am PDT.
>
> I will appreciate additional votes.
>
> Thanks,
> Masatake Iwasaki
>
> [1] https://lists.apache.org/thread.html/r16a7f36315a0673c7d522c41065e7ef9c9ee15c76ffcb5db80931002%40%3Ccommon-dev.hadoop.apache.org%3E
> [2] https://lists.apache.org/thread.html/e392b902273ee0c14ba34d72c44630e05f54cb3976109af510592ea2%401403330080%40%3Ccommon-dev.hadoop.apache.org%3E
> [3] https://hadoop.apache.org/bylaws.html
>
> On 2020/09/15 2:59, Masatake Iwasaki wrote:
>> Hi folks,
>>
>> This is the first release candidate for the second release of Apache Hadoop 2.10.
>> It contains 218 fixes/improvements since 2.10.0 [1].
>>
>> The RC0 artifacts are at:
>> http://home.apache.org/~iwasakims/hadoop-2.10.1-RC0/
>>
>> RC tag is release-2.10.1-RC0:
>> https://github.com/apache/hadoop/tree/release-2.10.1-RC0
>>
>> The maven artifacts are hosted here:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1279/
>>
>> My public key is available here:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The vote will run for 5 days, until Saturday, September 19 at 10:00 am PDT.
>>
>> [1] https://issues.apache.org/jira/issues/?jql=project%20in%20(HDFS%2C%20YARN%2C%20HADOOP%2C%20MAPREDUCE)%20AND%20resolution%20%3D%20Fixed%20AND%20fixVersion%20%3D%202.10.1
>>
>> Thanks,
>> Masatake Iwasaki
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [hidden email]
>> For additional commands, e-mail: [hidden email]
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]