Hadoop upgrade [Do we need to have same value for dfs.name.dir ] while upgrading

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Hadoop upgrade [Do we need to have same value for dfs.name.dir ] while upgrading

sandeeppaul
 

 

HI ,

 

I am trying to upgrade hadoop ,as part of this i have set Two environment
variables NEW_HADOOP_INSTALL and OLD_HADOOP_INSTALL .

 

After this i have executed the following command %
NEW_HADOOP_INSTALL/bin/start-dfs -upgrade

 

But namenode didnot started as it was throwing Inconsistent state exception
as the dfs.name.dir is not present

 

Here My question is while upgrading do we need to have the same old
configurations like dfs.name.dir..etc

 

Or Do i need to format that namenode first and then start upgrading?

 

Please let me know

 

Thanks

sandeep

 

****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

 

Reply | Threaded
Open this post in threaded view
|

Re: Hadoop upgrade [Do we need to have same value for dfs.name.dir ] while upgrading

Adarsh Sharma
sandeep wrote:

>  
>
>  
>
> HI ,
>
>  
>
> I am trying to upgrade hadoop ,as part of this i have set Two environment
> variables NEW_HADOOP_INSTALL and OLD_HADOOP_INSTALL .
>
>  
>
> After this i have executed the following command %
> NEW_HADOOP_INSTALL/bin/start-dfs -upgrade
>
>  
>
> But namenode didnot started as it was throwing Inconsistent state exception
> as the dfs.name.dir is not present
>
>  
>
> Here My question is while upgrading do we need to have the same old
> configurations like dfs.name.dir..etc
>
>  
>
> Or Do i need to format that namenode first and then start upgrading?
>
>  
>
> Please let me know
>
>  
>
> Thanks
>
> sandeep
>
>  
>
> ****************************************************************************
> ***********
> This e-mail and attachments contain confidential information from HUAWEI,
> which is intended only for the person or entity whose address is listed
> above. Any use of the information contained herein in any way (including,
> but not limited to, total or partial disclosure, reproduction, or
> dissemination) by persons other than the intended recipient's) is
> prohibited. If you receive this e-mail in error, please notify the sender by
> phone or email immediately and delete it!
>
>  
>
>
>  
Sandeep This Error occurs due to new namespace issue in Hadoop. Did u
copy dfs.name.dir and fs.checkpoint dir to new Hadoop  directory.

Namenode Format would cause u to loose all previous data.


Best Regards

Adarsh Sharma
Reply | Threaded
Open this post in threaded view
|

RE: Hadoop upgrade [Do we need to have same value for dfs.name.dir ] while upgrading

sandeeppaul
Thanks adarsh.

i have done the followign  for NEW_HADOOP_INSTALL (new hadoop version
installation )i have set same values for dfs.name.dir and fs.checkpoint
which i have configured in OLD_HADOOP_INSTALL(old hadoop version
installation)

Now it is working

Thanks
sandeep

****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

-----Original Message-----
From: Adarsh Sharma [mailto:[hidden email]]
Sent: Thursday, December 16, 2010 11:42 AM
To: [hidden email]
Subject: Re: Hadoop upgrade [Do we need to have same value for dfs.name.dir
] while upgrading

sandeep wrote:

>  
>
>  
>
> HI ,
>
>  
>
> I am trying to upgrade hadoop ,as part of this i have set Two environment
> variables NEW_HADOOP_INSTALL and OLD_HADOOP_INSTALL .
>
>  
>
> After this i have executed the following command %
> NEW_HADOOP_INSTALL/bin/start-dfs -upgrade
>
>  
>
> But namenode didnot started as it was throwing Inconsistent state
exception

> as the dfs.name.dir is not present
>
>  
>
> Here My question is while upgrading do we need to have the same old
> configurations like dfs.name.dir..etc
>
>  
>
> Or Do i need to format that namenode first and then start upgrading?
>
>  
>
> Please let me know
>
>  
>
> Thanks
>
> sandeep
>
>  
>
>
****************************************************************************
> ***********
> This e-mail and attachments contain confidential information from HUAWEI,
> which is intended only for the person or entity whose address is listed
> above. Any use of the information contained herein in any way (including,
> but not limited to, total or partial disclosure, reproduction, or
> dissemination) by persons other than the intended recipient's) is
> prohibited. If you receive this e-mail in error, please notify the sender
by
> phone or email immediately and delete it!
>
>  
>
>
>  
Sandeep This Error occurs due to new namespace issue in Hadoop. Did u
copy dfs.name.dir and fs.checkpoint dir to new Hadoop  directory.

Namenode Format would cause u to loose all previous data.


Best Regards

Adarsh Sharma