Can't run rebalancer because it thinks another is running

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Can't run rebalancer because it thinks another is running

Marcin Tustin
Hi,

I'm running HDFS in HA mode. I can't run the rebalancer because I get this message:

java.io.IOException: Another Balancer is running..  Exiting ...                                                                    
Dec 31, 2015 12:22:09 AM Balancing took 1.159 seconds

Any suggestions as to why that might be; and if it's the obvious that it's running elsewhere, how would I figure out where?

Thanks,
Marcin

Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity

Reply | Threaded
Open this post in threaded view
|

Re: Can't run rebalancer because it thinks another is running

Anu Engineer
Balancer writes the hostname to a file called  /system/balancer.id”  if you check that file you should be able to see where the other balancer is running.

Thanks
Anu


From: Marcin Tustin <[hidden email]>
Date: Wednesday, December 30, 2015 at 4:32 PM
To: "[hidden email]" <[hidden email]>
Subject: Can't run rebalancer because it thinks another is running

Hi,

I'm running HDFS in HA mode. I can't run the rebalancer because I get this message:

java.io.IOException: Another Balancer is running..  Exiting ...                                                                    
Dec 31, 2015 12:22:09 AM Balancing took 1.159 seconds

Any suggestions as to why that might be; and if it's the obvious that it's running elsewhere, how would I figure out where?

Thanks,
Marcin

Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity

Reply | Threaded
Open this post in threaded view
|

Re: Can't run rebalancer because it thinks another is running

Chris Nauroth
If this is an Ambari-managed cluster that was transitioned from non-HA to running in HA mode, then you might be interested in a known Ambari bug:


If your hdfs-site.xml contains the "non-HA properties" described in that issue, then a viable workaround would be to remove those properties.

--Chris Nauroth

From: Anu Engineer <[hidden email]>
Date: Monday, January 4, 2016 at 3:47 PM
To: Marcin Tustin <[hidden email]>, "[hidden email]" <[hidden email]>
Subject: Re: Can't run rebalancer because it thinks another is running

Balancer writes the hostname to a file called  /system/balancer.id”  if you check that file you should be able to see where the other balancer is running.

Thanks
Anu


From: Marcin Tustin <[hidden email]>
Date: Wednesday, December 30, 2015 at 4:32 PM
To: "[hidden email]" <[hidden email]>
Subject: Can't run rebalancer because it thinks another is running

Hi,

I'm running HDFS in HA mode. I can't run the rebalancer because I get this message:

java.io.IOException: Another Balancer is running..  Exiting ...                                                                    
Dec 31, 2015 12:22:09 AM Balancing took 1.159 seconds

Any suggestions as to why that might be; and if it's the obvious that it's running elsewhere, how would I figure out where?

Thanks,
Marcin

Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity

Reply | Threaded
Open this post in threaded view
|

Re: Can't run rebalancer because it thinks another is running

Marcin Tustin
Hah, we definitely do have those properties. Thank you for this!

On Tue, Jan 5, 2016 at 5:23 PM, Chris Nauroth <[hidden email]> wrote:
If this is an Ambari-managed cluster that was transitioned from non-HA to running in HA mode, then you might be interested in a known Ambari bug:


If your hdfs-site.xml contains the "non-HA properties" described in that issue, then a viable workaround would be to remove those properties.

--Chris Nauroth

From: Anu Engineer <[hidden email]>
Date: Monday, January 4, 2016 at 3:47 PM
To: Marcin Tustin <[hidden email]>, "[hidden email]" <[hidden email]>
Subject: Re: Can't run rebalancer because it thinks another is running

Balancer writes the hostname to a file called  /system/balancer.id”  if you check that file you should be able to see where the other balancer is running.

Thanks
Anu


From: Marcin Tustin <[hidden email]>
Date: Wednesday, December 30, 2015 at 4:32 PM
To: "[hidden email]" <[hidden email]>
Subject: Can't run rebalancer because it thinks another is running

Hi,

I'm running HDFS in HA mode. I can't run the rebalancer because I get this message:

java.io.IOException: Another Balancer is running..  Exiting ...                                                                    
Dec 31, 2015 12:22:09 AM Balancing took 1.159 seconds

Any suggestions as to why that might be; and if it's the obvious that it's running elsewhere, how would I figure out where?

Thanks,
Marcin

Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity



Want to work at Handy? Check out our culture deck and open roles
Latest news at Handy
Handy just raised $50m led by Fidelity