[HELP] JobTracker is not starting up suddenly [Remote exception ]

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

[HELP] JobTracker is not starting up suddenly [Remote exception ]

Pallavi Palleti
I have been using hadoop for my work and it was working well till yesterday. Suddenly since yesterday, I started getting below  error when I ran start-all.sh. Jobtracker is failing to start with the below error. Can some one please help on this.

2007-08-06 10:26:32,365 WARN org.apache.hadoop.mapred.JobTracker: Error starting tracker: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.dfs.SafeModeException: Cannot delete /tmp/hadoop-user/mapred/system. Name node is in safe mode.
Safe mode will be turned off automatically.
        at org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1034)
        at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:404)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:341)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:573)

        at org.apache.hadoop.ipc.Client.call(Client.java:471)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
        at org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:355)
        at org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.delete(DistributedFileSystem.java:166)
        at org.apache.hadoop.fs.ChecksumFileSystem.delete(ChecksumFileSystem.java:504)
        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:625)
        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:106)
        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1732)


Thanks in advance,
Reply | Threaded
Open this post in threaded view
|

Re: [HELP] JobTracker is not starting up suddenly [Remote exception ]

Arun C Murthy-2
On Sun, Aug 05, 2007 at 10:25:10PM -0700, novice user wrote:

>
>I have been using hadoop for my work and it was working well till yesterday.
>Suddenly since yesterday, I started getting below  error when I ran
>start-all.sh. Jobtracker is failing to start with the below error. Can some
>one please help on this.
>
>2007-08-06 10:26:32,365 WARN org.apache.hadoop.mapred.JobTracker: Error
>starting tracker: org.apache.hadoop.ipc.RemoteException:
>org.apache.hadoop.dfs.SafeModeException: Cannot delete
>/tmp/hadoop-user/mapred/system. Name node is in safe mode.
>Safe mode will be turned off automatically.

As per that, the NameNode is in *Safe mode* and will be turned off automatically, all you need to do is to wait for a little bit...

Arun

>        at org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1034)
>        at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:404)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:341)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:573)
>
>        at org.apache.hadoop.ipc.Client.call(Client.java:471)
>        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
>        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>        at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>        at org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:355)
>        at
>org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.delete(DistributedFileSystem.java:166)
>        at
>org.apache.hadoop.fs.ChecksumFileSystem.delete(ChecksumFileSystem.java:504)
>        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:625)
>        at
>org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:106)
>        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1732)
>
>
>Thanks in advance,
>--
>View this message in context: http://www.nabble.com/-HELP--JobTracker-is-not-starting-up-suddenly--Remote-exception---tf4222326.html#a12011249
>Sent from the Hadoop Users mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: [HELP] JobTracker is not starting up suddenly [Remote exception ]

Pallavi Palleti
No. I don't think so as I have waited for more than 15 mins.
By the way, the problem is solved when I removed /tmp/hadoop-user directory and restarted whole process(formatting namenode, run start-all.sh) again.

Thanks

Arun C Murthy wrote
On Sun, Aug 05, 2007 at 10:25:10PM -0700, novice user wrote:
>
>I have been using hadoop for my work and it was working well till yesterday.
>Suddenly since yesterday, I started getting below  error when I ran
>start-all.sh. Jobtracker is failing to start with the below error. Can some
>one please help on this.
>
>2007-08-06 10:26:32,365 WARN org.apache.hadoop.mapred.JobTracker: Error
>starting tracker: org.apache.hadoop.ipc.RemoteException:
>org.apache.hadoop.dfs.SafeModeException: Cannot delete
>/tmp/hadoop-user/mapred/system. Name node is in safe mode.
>Safe mode will be turned off automatically.

As per that, the NameNode is in *Safe mode* and will be turned off automatically, all you need to do is to wait for a little bit...

Arun

>        at org.apache.hadoop.dfs.FSNamesystem.delete(FSNamesystem.java:1034)
>        at org.apache.hadoop.dfs.NameNode.delete(NameNode.java:404)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:341)
>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:573)
>
>        at org.apache.hadoop.ipc.Client.call(Client.java:471)
>        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
>        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>        at
>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>        at org.apache.hadoop.dfs.$Proxy0.delete(Unknown Source)
>        at org.apache.hadoop.dfs.DFSClient.delete(DFSClient.java:355)
>        at
>org.apache.hadoop.dfs.DistributedFileSystem$RawDistributedFileSystem.delete(DistributedFileSystem.java:166)
>        at
>org.apache.hadoop.fs.ChecksumFileSystem.delete(ChecksumFileSystem.java:504)
>        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:625)
>        at
>org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:106)
>        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1732)
>
>
>Thanks in advance,
>--
>View this message in context: http://www.nabble.com/-HELP--JobTracker-is-not-starting-up-suddenly--Remote-exception---tf4222326.html#a12011249
>Sent from the Hadoop Users mailing list archive at Nabble.com.
>