Problem in fully distributed operation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Problem in fully distributed operation


I have been following the Getting Started guide to get Hadoop up and running
in fully distributed operation but have encountered some problems. The
version I'm using is hadoop-0.5.0. I have 2 nodes, one master and a slave.
Thus, the slaves file only contains the hostname of the slave node. When I
tried to copy the input files into the distributed filesystem using 'bin/hadoop
dfs -put input input', the following error occurs:

2006-11-27 15:48:45,745 INFO org.apache.hadoop.ipc.Server: Server handler 1
on 9000 call error: failed to create file
/user/aaron/input/.hadoop-default.xml.crc on client x.x.x.x.x because
target-length is 0, below MIN_REPLICATION (1) failed to create file /user/aaron/input/.hadoop-
default.xml.crc on client x.x.x.x.x because target-length is 0, below
        at org.apache.hadoop.dfs.FSNamesystem.startFile(
        at org.apache.hadoop.dfs.NameNode.create(
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(
        at java.lang.reflect.Method.invoke(
        at org.apache.hadoop.ipc.RPC$
        at org.apache.hadoop.ipc.Server$
2006-11-27 15:48:45,765 INFO org.apache.hadoop.fs.FSNamesystem: Attempt to
release a lock from an unknown lease holder DFSClient_-734793125 for

I can only manage to get rid of this error by listing the hostname of the
master node into the slaves file as well. Though it managed to complete the
operation but seemed that it is not in fully distributed mode as the logs
from the datanode and tasktracker of the slave node says that it is

2006-11-27 16:13:14,984 INFO org.apache.hadoop.ipc.RPC: Server at
apple034/x.x.x.x:9001 not available yet, Zzzzz...

Would appreciate if anyone can advise.