[VOTE] Release Apache Hadoop 2.8.5 (RC0)

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

[VOTE] Release Apache Hadoop 2.8.5 (RC0)

俊平堵-2
Hi all,

     I've created the first release candidate (RC0) for Apache
Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It
includes 33 important fixes and improvements.


    The RC artifacts are available at:
http://home.apache.org/~junping_du/hadoop-2.8.5-RC0


    The RC tag in git is: release-2.8.5-RC0



    The maven artifacts are available via repository.apache.org<
http://repository.apache.org> at:

https://repository.apache.org/content/repositories/orgapachehadoop-1140


    Please try the release and vote; the vote will run for the usual 5 working
days, ending on 9/15/2018 PST time.


Thanks,


Junping
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

Yesha Vora
+1 (binding)

Tested the following:
- launch Pseudo-Distributed 1 node cluster
- Tested with word count / teragen / terasort / nnbench/ mrbench on yarn
- Validate yarn UI
- Test basic yarn cli operations such as -kill, -status, -appStates, -appTypes

--
Yesha Vora


________________________________________
From: 俊平堵 <[hidden email]>
Sent: Monday, September 10, 2018 5:00 AM
To: Hadoop Common; Hdfs-dev; [hidden email]; [hidden email]
Cc: junpingdu(堵俊平)
Subject: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

Hi all,

     I've created the first release candidate (RC0) for Apache
Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It
includes 33 important fixes and improvements.


    The RC artifacts are available at:
http://home.apache.org/~junping_du/hadoop-2.8.5-RC0


    The RC tag in git is: release-2.8.5-RC0



    The maven artifacts are available via repository.apache.org<
http://repository.apache.org> at:

https://repository.apache.org/content/repositories/orgapachehadoop-1140


    Please try the release and vote; the vote will run for the usual 5 working
days, ending on 9/15/2018 PST time.


Thanks,


Junping


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)(Internet mail)

junpingdu(堵俊平)
In reply to this post by 俊平堵-2
Hi Ajay,
     I cannot reproduce this issue. Can you check if there is some issues with your system settings or configurations?

Thanks,

Junping

On 13/09/2018, 00:17, "Ajay Kumar" <[hidden email]> wrote:

    Built from source. Not sure if I am missing some config but MR test jobs (Pi) are failing with error. ("Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster".)
     Anyone else facing same issue?
       
        See below exception in Nodemanager which I haven't seen earlier.    2018-09-11 11:26:31,343 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started
        2018-09-11 11:26:31,386 WARN org.apache.hadoop.yarn.util.ResourceCalculatorPlugin: java.lang.UnsupportedOperationException: Could not determine OS: Failed to instantiate default resource calculator.
        java.lang.UnsupportedOperationException: Could not determine OS
        at org.apache.hadoop.util.SysInfo.newInstance(SysInfo.java:43)
        at org.apache.hadoop.yarn.util.ResourceCalculatorPlugin.<init>(ResourceCalculatorPlugin.java:41)
        at org.apache.hadoop.yarn.util.ResourceCalculatorPlugin.getResourceCalculatorPlugin(ResourceCalculatorPlugin.java:191)
        at org.apache.hadoop.yarn.server.nodemanager.NodeResourceMonitorImpl.serviceInit(NodeResourceMonitorImpl.java:74)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:357)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:636)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:684)
       
        Thanks,
        Ajay
   
    On 9/12/18, 6:31 AM, "Kihwal Lee" <[hidden email]> wrote:
   
        +1 (binding)
       
        - Built from source
        - Brought up a single node cluster
        - Checked basic HDFS functions and checked the UIs
        - Ran several simple jobs.
       
       
        On Mon, Sep 10, 2018 at 7:01 AM 俊平堵 <[hidden email]> wrote:
       
        > Hi all,
        >
        >      I've created the first release candidate (RC0) for Apache
        > Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It
        > includes 33 important fixes and improvements.
        >
        >
        >     The RC artifacts are available at:
        > http://home.apache.org/~junping_du/hadoop-2.8.5-RC0
        >
        >
        >     The RC tag in git is: release-2.8.5-RC0
        >
        >
        >
        >     The maven artifacts are available via repository.apache.org<
        > http://repository.apache.org> at:
        >
        > https://repository.apache.org/content/repositories/orgapachehadoop-1140
        >
        >
        >     Please try the release and vote; the vote will run for the usual 5
        > working
        > days, ending on 9/15/2018 PST time.
        >
        >
        > Thanks,
        >
        >
        > Junping
        >
       
   
   


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]
Reply | Threaded
Open this post in threaded view
|

[VOTE] [RESULT] Release Apache Hadoop 2.8.5 (RC0)

俊平堵-2
In reply to this post by Yesha Vora
Thanks all who helped to verify and vote!


I give my binding +1 to conclude the vote for 2.8.5 RC0:

- Built from source and verified signatures

- Deployed a small distributed cluster and run simple jobs

- Verified UI of daemons, such as: NN, RM, DN, NM, etc


Now, our RC0 for 2.8.5 got:


6 binding +1s, from:

     Jason Lowe, Eric Payne, Kihwal Lee, Brahma Reddy Battula, Yesha Vora,
Junping Du


4 non-binding +1s, from:

    Gabor Bota, Eric Badger, Zsolt Venczel, Kitti Nánási


and no -1s.


So I am glad to announce that the vote for 2.8.5 RC0 passes.


Thanks everyone listed above who tried the release candidate and vote and
all who ever help with 2.8.5 release effort in all kinds of ways.

I'll push the release bits and send out an announcement for 2.8.5 soon.


Thanks,


Junping

Kitti Nánási <[hidden email]> 于2018年9月13日周四 上午8:34写道:

> Thanks for working on this Junping!
>
> +1 (non-binding)
>
> - checked out git tag release-2.8.5-RC0
> - built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
> - deployed on a 3 node cluster
> - ran terasort, teragen, teravalidate with success
> - executed basic hdfs and dfsadmin commands
>
> Thanks,
> Kitti
>
>
> On Wed, Sep 12, 2018 at 2:37 PM, Yesha Vora <[hidden email]> wrote:
>
>> +1 (binding)
>>
>> Tested the following:
>> - launch Pseudo-Distributed 1 node cluster
>> - Tested with word count / teragen / terasort / nnbench/ mrbench on yarn
>> - Validate yarn UI
>> - Test basic yarn cli operations such as -kill, -status, -appStates,
>> -appTypes
>>
>> --
>> Yesha Vora
>>
>>
>> ________________________________________
>> From: 俊平堵 <[hidden email]>
>> Sent: Monday, September 10, 2018 5:00 AM
>> To: Hadoop Common; Hdfs-dev; [hidden email];
>> [hidden email]
>> Cc: junpingdu(堵俊平)
>> Subject: [VOTE] Release Apache Hadoop 2.8.5 (RC0)
>>
>> Hi all,
>>
>>      I've created the first release candidate (RC0) for Apache
>> Hadoop 2.8.5. This is our next point release to follow up 2.8.4. It
>> includes 33 important fixes and improvements.
>>
>>
>>     The RC artifacts are available at:
>> http://home.apache.org/~junping_du/hadoop-2.8.5-RC0
>>
>>
>>     The RC tag in git is: release-2.8.5-RC0
>>
>>
>>
>>     The maven artifacts are available via repository.apache.org<
>> http://repository.apache.org> at:
>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1140
>>
>>
>>     Please try the release and vote; the vote will run for the usual 5
>> working
>> days, ending on 9/15/2018 PST time.
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [hidden email]
>> For additional commands, e-mail: [hidden email]
>>
>>
>
Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

Marton, Elek-2
In reply to this post by 俊平堵-2
Yes. Currently you need to commit the generated site (source + rendered
site, both are on the same branch).

We can create a jenkins job to do the generation + commit automatically.

I updated the wiki to make it more clean.

Marton

On 9/22/18 10:48 PM, Anu Engineer wrote:

> I believe that you need to regenerate the site using ‘hugo’ command (hugo is a site builder). Then commit and push the generated files.
>
> Thanks
> Anu
>
>
> On 9/22/18, 9:56 AM, "俊平堵" <[hidden email]> wrote:
>
>      Martin, thanks for your reply. It works now, but after git changes - I
>      haven’t seen Apache Hadoop website get refreshed. It seems like to need
>      some manually steps to refresh the website -if so, can you also update to
>      the wiki?
>      
>      Thanks,
>      
>      Junping
>      
>      Elek, Marton <[hidden email]>于2018年9月20日 周四下午1:40写道:
>      
>      > Please try
>      >
>      > git clone https://gitbox.apache.org/repos/asf/hadoop-site.git -b asf-site
>      >
>      > (It seems git tries to check out master instead of the branch).
>      >
>      > I updated the wiki, sorry for the inconvenience.
>      >
>      > Marton
>      >
>      > On 9/18/18 8:05 PM, 俊平堵 wrote:
>      > > Hey Marton,
>      > >       The new release web-site actually doesn't work for me.  When I
>      > > follow your steps in wiki, and hit the issue during git clone repository
>      > > (writable) for hadoop-site as below:
>      > >
>      > > git clone https://gitbox.apache.org/repos/asf/hadoop-site.git
>      > > Cloning into 'hadoop-site'...
>      > > remote: Counting objects: 252414, done.
>      > > remote: Compressing objects: 100% (29625/29625), done.
>      > > remote: Total 252414 (delta 219617), reused 252211 (delta 219422)
>      > > Receiving objects: 100% (252414/252414), 98.78 MiB | 3.32 MiB/s, done.
>      > > Resolving deltas: 100% (219617/219617), done.
>      > > warning: remote HEAD refers to nonexistent ref, unable to checkout.
>      > >
>      > > Can you check above repository is correct for clone?
>      > > I can clone readable repository (https://github.com/apache/hadoop-site)
>      > > successfully though but cannot push back changes which is expected.
>      > >
>      > > Thanks,
>      > >
>      > > Junping
>      > >
>      > > Elek, Marton <[hidden email] <mailto:[hidden email]>>于2018年9月17日
>      > > 周一上午6:15写道:
>      > >
>      > >     Hi Junping,
>      > >
>      > >     Thank you to work on this release.
>      > >
>      > >     This release is the first release after the hadoop site change, and I
>      > >     would like to be sure that everything works fine.
>      > >
>      > >     Unfortunately I didn't get permission to edit the old wiki, but this
>      > is
>      > >     definition of the site update on the new wiki:
>      > >
>      > >
>      > https://cwiki.apache.org/confluence/display/HADOOP/How+to+generate+and+push+ASF+web+site+after+HADOOP-14163
>      > >
>      > >     Please let me know if something is not working for you...
>      > >
>      > >     Thanks,
>      > >     Marton
>      > >
>      > >
>      > >     On 09/10/2018 02:00 PM, 俊平堵 wrote:
>      > >      > Hi all,
>      > >      >
>      > >      >       I've created the first release candidate (RC0) for Apache
>      > >      > Hadoop 2.8.5. This is our next point release to follow up 2.8.4.
>      > It
>      > >      > includes 33 important fixes and improvements.
>      > >      >
>      > >      >
>      > >      >      The RC artifacts are available at:
>      > >      > http://home.apache.org/~junping_du/hadoop-2.8.5-RC0
>      > >      >
>      > >      >
>      > >      >      The RC tag in git is: release-2.8.5-RC0
>      > >      >
>      > >      >
>      > >      >
>      > >      >      The maven artifacts are available via repository.apache.org
>      > >     <http://repository.apache.org><
>      > >      > http://repository.apache.org> at:
>      > >      >
>      > >      >
>      > >
>      > https://repository.apache.org/content/repositories/orgapachehadoop-1140
>      > >      >
>      > >      >
>      > >      >      Please try the release and vote; the vote will run for the
>      > >     usual 5 working
>      > >      > days, ending on 9/15/2018 PST time.
>      > >      >
>      > >      >
>      > >      > Thanks,
>      > >      >
>      > >      >
>      > >      > Junping
>      > >      >
>      > >
>      >
>      
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: [VOTE] Release Apache Hadoop 2.8.5 (RC0)

俊平堵-2
Thanks Elek and Anu, it works now. I am sending letters to announce 2.8.5
get released.

Thanks,

Junping

Elek, Marton <[hidden email]> 于2018年9月23日周日 上午7:50写道:

> Yes. Currently you need to commit the generated site (source + rendered
> site, both are on the same branch).
>
> We can create a jenkins job to do the generation + commit automatically.
>
> I updated the wiki to make it more clean.
>
> Marton
>
> On 9/22/18 10:48 PM, Anu Engineer wrote:
> > I believe that you need to regenerate the site using ‘hugo’ command
> (hugo is a site builder). Then commit and push the generated files.
> >
> > Thanks
> > Anu
> >
> >
> > On 9/22/18, 9:56 AM, "俊平堵" <[hidden email]> wrote:
> >
> >      Martin, thanks for your reply. It works now, but after git changes
> - I
> >      haven’t seen Apache Hadoop website get refreshed. It seems like to
> need
> >      some manually steps to refresh the website -if so, can you also
> update to
> >      the wiki?
> >
> >      Thanks,
> >
> >      Junping
> >
> >      Elek, Marton <[hidden email]>于2018年9月20日 周四下午1:40写道:
> >
> >      > Please try
> >      >
> >      > git clone https://gitbox.apache.org/repos/asf/hadoop-site.git -b
> asf-site
> >      >
> >      > (It seems git tries to check out master instead of the branch).
> >      >
> >      > I updated the wiki, sorry for the inconvenience.
> >      >
> >      > Marton
> >      >
> >      > On 9/18/18 8:05 PM, 俊平堵 wrote:
> >      > > Hey Marton,
> >      > >       The new release web-site actually doesn't work for me.
> When I
> >      > > follow your steps in wiki, and hit the issue during git clone
> repository
> >      > > (writable) for hadoop-site as below:
> >      > >
> >      > > git clone https://gitbox.apache.org/repos/asf/hadoop-site.git
> >      > > Cloning into 'hadoop-site'...
> >      > > remote: Counting objects: 252414, done.
> >      > > remote: Compressing objects: 100% (29625/29625), done.
> >      > > remote: Total 252414 (delta 219617), reused 252211 (delta
> 219422)
> >      > > Receiving objects: 100% (252414/252414), 98.78 MiB | 3.32
> MiB/s, done.
> >      > > Resolving deltas: 100% (219617/219617), done.
> >      > > warning: remote HEAD refers to nonexistent ref, unable to
> checkout.
> >      > >
> >      > > Can you check above repository is correct for clone?
> >      > > I can clone readable repository (
> https://github.com/apache/hadoop-site)
> >      > > successfully though but cannot push back changes which is
> expected.
> >      > >
> >      > > Thanks,
> >      > >
> >      > > Junping
> >      > >
> >      > > Elek, Marton <[hidden email] <mailto:[hidden email]
> >>于2018年9月17日
> >      > > 周一上午6:15写道:
> >      > >
> >      > >     Hi Junping,
> >      > >
> >      > >     Thank you to work on this release.
> >      > >
> >      > >     This release is the first release after the hadoop site
> change, and I
> >      > >     would like to be sure that everything works fine.
> >      > >
> >      > >     Unfortunately I didn't get permission to edit the old wiki,
> but this
> >      > is
> >      > >     definition of the site update on the new wiki:
> >      > >
> >      > >
> >      >
> https://cwiki.apache.org/confluence/display/HADOOP/How+to+generate+and+push+ASF+web+site+after+HADOOP-14163
> >      > >
> >      > >     Please let me know if something is not working for you...
> >      > >
> >      > >     Thanks,
> >      > >     Marton
> >      > >
> >      > >
> >      > >     On 09/10/2018 02:00 PM, 俊平堵 wrote:
> >      > >      > Hi all,
> >      > >      >
> >      > >      >       I've created the first release candidate (RC0) for
> Apache
> >      > >      > Hadoop 2.8.5. This is our next point release to follow
> up 2.8.4.
> >      > It
> >      > >      > includes 33 important fixes and improvements.
> >      > >      >
> >      > >      >
> >      > >      >      The RC artifacts are available at:
> >      > >      > http://home.apache.org/~junping_du/hadoop-2.8.5-RC0
> >      > >      >
> >      > >      >
> >      > >      >      The RC tag in git is: release-2.8.5-RC0
> >      > >      >
> >      > >      >
> >      > >      >
> >      > >      >      The maven artifacts are available via
> repository.apache.org
> >      > >     <http://repository.apache.org><
> >      > >      > http://repository.apache.org> at:
> >      > >      >
> >      > >      >
> >      > >
> >      >
> https://repository.apache.org/content/repositories/orgapachehadoop-1140
> >      > >      >
> >      > >      >
> >      > >      >      Please try the release and vote; the vote will run
> for the
> >      > >     usual 5 working
> >      > >      > days, ending on 9/15/2018 PST time.
> >      > >      >
> >      > >      >
> >      > >      > Thanks,
> >      > >      >
> >      > >      >
> >      > >      > Junping
> >      > >      >
> >      > >
> >      >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [hidden email]
> > For additional commands, e-mail: [hidden email]
> >
>