Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Dibyendu Karmakar
Hiii, I am new in hadoop. Trying to configure it in fully distributed mode.
But after the command bin/start-all.sh or bin/start-mapred.sh or
bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
HELP PLEASE...

I'm using hadoop 1.0.3 version.
I am using 2 computers -
172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
172.16.4.14 - DATANODE

My conf is somewhat -
< core-site.xml >
fs.default.name ------ hdfs://172.16.4.120:9001
hadoop.tmp.dir ------
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp

< hdfs-site.xml >
dfs.replication -- 2
dfs.name.dir ---
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
dfs.data.dir --- /tmp/hadoop_data

< mapred-site.xml >
mapred.job.tracker --- 172.16.4.120:9002

< slaves >
172.16.4.14
172.16.4.120

< masters >
172.16.4.120

TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
< hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local

PLEASE HELP ANYONE...
IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
THANK YOU SO MUCH...
--
Dibyendu Karmakar,
< [hidden email] >
Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Mohammad Tariq
Hello Dibyendu,

       Are you able to see anything at http://172.16.4.120:50030?What does JPS show on your terminal? Whatever logs you have posted here look incomplete to me. Can you do a quick recheck?

Regards,
    Mohammad Tariq



On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar <[hidden email]> wrote:
Hiii, I am new in hadoop. Trying to configure it in fully distributed mode.
But after the command bin/start-all.sh or bin/start-mapred.sh or
bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
HELP PLEASE...

I'm using hadoop 1.0.3 version.
I am using 2 computers -
172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
172.16.4.14 - DATANODE

My conf is somewhat -
< core-site.xml >
fs.default.name ------ hdfs://172.16.4.120:9001
hadoop.tmp.dir ------
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp

< hdfs-site.xml >
dfs.replication -- 2
dfs.name.dir ---
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
dfs.data.dir --- /tmp/hadoop_data

< mapred-site.xml >
mapred.job.tracker --- 172.16.4.120:9002

< slaves >
172.16.4.14
172.16.4.120

< masters >
172.16.4.120

TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
< hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local

PLEASE HELP ANYONE...
IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
THANK YOU SO MUCH...
--
Dibyendu Karmakar,
< [hidden email] >

Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Dibyendu Karmakar
Yes, the jps command gives me the following...

on 172.16.4.120 ---
10160 SecondaryNameNode
9794 NameNode
9980 DataNode
9388 Jps
16267 JobTracker

on 172.16.4.14 --
6812 Jps
4523 DataNode


On 12/4/12, Mohammad Tariq <[hidden email]> wrote:

> Hello Dibyendu,
>
>        Are you able to see anything at http://172.16.4.120:50030?What does
> JPS show on your terminal? Whatever logs you have posted here look
> incomplete to me. Can you do a quick recheck?
>
> Regards,
>     Mohammad Tariq
>
>
>
> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
> <[hidden email]>wrote:
>
>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>> mode.
>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>> HELP PLEASE...
>>
>> I'm using hadoop 1.0.3 version.
>> I am using 2 computers -
>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
>> 172.16.4.14 - DATANODE
>>
>> My conf is somewhat -
>> < core-site.xml >
>> fs.default.name ------ hdfs://172.16.4.120:9001
>> hadoop.tmp.dir ------
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>
>> < hdfs-site.xml >
>> dfs.replication -- 2
>> dfs.name.dir ---
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>> dfs.data.dir --- /tmp/hadoop_data
>>
>> < mapred-site.xml >
>> mapred.job.tracker --- 172.16.4.120:9002
>>
>> < slaves >
>> 172.16.4.14
>> 172.16.4.120
>>
>> < masters >
>> 172.16.4.120
>>
>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>> STARTUP_MSG:
>> /************************************************************
>> STARTUP_MSG: Starting TaskTracker
>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> STARTUP_MSG:   args = []
>> STARTUP_MSG:   version = 1.0.3
>> STARTUP_MSG:   build =
>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> ************************************************************/
>> 2012-12-04 15:40:23,864 INFO
>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> MetricsSystem,sub=Stats registered.
>> 2012-12-04 15:40:24,326 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>> period at 10 second(s).
>> 2012-12-04 15:40:24,326 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>> system started
>> 2012-12-04 15:40:24,559 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> ugi registered.
>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>> global filtersafety
>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> 2012-12-04 15:40:34,846 INFO
>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>> Starting tasktracker with owner as dibyendu_karmakar
>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>> Good mapred local directories are:
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>
>> PLEASE HELP ANYONE...
>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>> THANK YOU SO MUCH...
>> --
>> Dibyendu Karmakar,
>> < [hidden email] >
>>
>


--
Dibyendu Karmakar,
< [hidden email] >
Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Dibyendu Karmakar
THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
ALSO --- THANK YOU FOR THE REPLY


2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:20:46,983 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:20:47,044 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:20:48,478 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:20:59,164 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:21:11,971 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:21:12,031 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:21:12,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:21:22,728 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:23:20,876 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:23:20,937 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:23:21,969 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:23:32,658 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:24:12,577 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:24:12,638 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:24:13,267 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:24:21,373 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:26:45,403 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:26:45,464 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:26:46,092 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:26:56,381 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:10,119 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:10,180 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:10,824 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:16,383 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:25,458 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:25,519 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:26,661 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:37,267 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:44,677 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:44,739 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:46,176 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:56,864 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:24,250 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:24,313 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:33:24,851 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:35,155 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:36:05,810 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:36:05,869 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:36:06,104 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:36:16,791 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local


On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:

> Yes, the jps command gives me the following...
>
> on 172.16.4.120 ---
> 10160 SecondaryNameNode
> 9794 NameNode
> 9980 DataNode
> 9388 Jps
> 16267 JobTracker
>
> on 172.16.4.14 --
> 6812 Jps
> 4523 DataNode
>
>
> On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>> Hello Dibyendu,
>>
>>        Are you able to see anything at http://172.16.4.120:50030?What
>> does
>> JPS show on your terminal? Whatever logs you have posted here look
>> incomplete to me. Can you do a quick recheck?
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>> <[hidden email]>wrote:
>>
>>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>>> mode.
>>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>> HELP PLEASE...
>>>
>>> I'm using hadoop 1.0.3 version.
>>> I am using 2 computers -
>>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
>>> 172.16.4.14 - DATANODE
>>>
>>> My conf is somewhat -
>>> < core-site.xml >
>>> fs.default.name ------ hdfs://172.16.4.120:9001
>>> hadoop.tmp.dir ------
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>
>>> < hdfs-site.xml >
>>> dfs.replication -- 2
>>> dfs.name.dir ---
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>> dfs.data.dir --- /tmp/hadoop_data
>>>
>>> < mapred-site.xml >
>>> mapred.job.tracker --- 172.16.4.120:9002
>>>
>>> < slaves >
>>> 172.16.4.14
>>> 172.16.4.120
>>>
>>> < masters >
>>> 172.16.4.120
>>>
>>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:40:23,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:40:24,559 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:40:34,846 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>
>>> PLEASE HELP ANYONE...
>>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>> THANK YOU SO MUCH...
>>> --
>>> Dibyendu Karmakar,
>>> < [hidden email] >
>>>
>>
>
>
> --
> Dibyendu Karmakar,
> < [hidden email] >
>

--
Dibyendu Karmakar,
< [hidden email] >

hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log (27K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Mohammad Tariq
I see. Could you please post your JT logs? Also, comment out "127.0.1.1" in your "/etc/hosts" and try to restart the cluster. I am assuming rest of the things are working fine.

(I am sorry as I am not able to post any direct answer, as it's very difficult to diagnose the actual problem without error logs).

Regards,
    Mohammad Tariq



On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <[hidden email]> wrote:
THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
ALSO --- THANK YOU FOR THE REPLY


2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:20:46,983 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:20:47,044 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:20:48,478 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:20:59,164 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:21:11,971 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:21:12,031 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:21:12,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:21:22,728 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:23:20,876 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:23:20,937 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:23:21,969 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:23:32,658 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:24:12,577 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:24:12,638 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:24:13,267 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:24:21,373 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:26:45,403 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:26:45,464 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:26:46,092 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:26:56,381 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:10,119 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:10,180 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:10,824 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:16,383 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:25,458 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:25,519 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:26,661 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:37,267 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:44,677 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:44,739 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:46,176 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:56,864 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:24,250 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:24,313 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:33:24,851 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:35,155 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:36:05,810 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:36:05,869 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:36:06,104 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:36:16,791 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local


On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
> Yes, the jps command gives me the following...
>
> on 172.16.4.120 ---
> 10160 SecondaryNameNode
> 9794 NameNode
> 9980 DataNode
> 9388 Jps
> 16267 JobTracker
>
> on 172.16.4.14 --
> 6812 Jps
> 4523 DataNode
>
>
> On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>> Hello Dibyendu,
>>
>>        Are you able to see anything at http://172.16.4.120:50030?What
>> does
>> JPS show on your terminal? Whatever logs you have posted here look
>> incomplete to me. Can you do a quick recheck?
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>> <[hidden email]>wrote:
>>
>>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>>> mode.
>>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>> HELP PLEASE...
>>>
>>> I'm using hadoop 1.0.3 version.
>>> I am using 2 computers -
>>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
>>> 172.16.4.14 - DATANODE
>>>
>>> My conf is somewhat -
>>> < core-site.xml >
>>> fs.default.name ------ hdfs://172.16.4.120:9001
>>> hadoop.tmp.dir ------
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>
>>> < hdfs-site.xml >
>>> dfs.replication -- 2
>>> dfs.name.dir ---
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>> dfs.data.dir --- /tmp/hadoop_data
>>>
>>> < mapred-site.xml >
>>> mapred.job.tracker --- 172.16.4.120:9002
>>>
>>> < slaves >
>>> 172.16.4.14
>>> 172.16.4.120
>>>
>>> < masters >
>>> 172.16.4.120
>>>
>>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:40:23,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:40:24,559 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:40:34,846 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>
>>> PLEASE HELP ANYONE...
>>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>> THANK YOU SO MUCH...
>>> --
>>> Dibyendu Karmakar,
>>> < [hidden email] >
>>>
>>
>
>
> --
> Dibyendu Karmakar,
> < [hidden email] >
>


--
Dibyendu Karmakar,
< [hidden email] >

Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Nitin Pawar
surprising to see that TT is restarting without any error after it checks for the directory ownership mapred local directories. 

can you try putting tasktracker startup in debug mode? (which version of JDK are you using? )


On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <[hidden email]> wrote:
I see. Could you please post your JT logs? Also, comment out "127.0.1.1" in your "/etc/hosts" and try to restart the cluster. I am assuming rest of the things are working fine.

(I am sorry as I am not able to post any direct answer, as it's very difficult to diagnose the actual problem without error logs).

Regards,
    Mohammad Tariq



On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <[hidden email]> wrote:
THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
ALSO --- THANK YOU FOR THE REPLY


2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:20:46,983 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:20:47,044 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:20:48,478 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:20:59,164 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:21:11,971 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:21:12,031 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:21:12,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:21:22,728 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:23:20,876 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:23:20,937 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:23:21,969 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:23:32,658 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:24:12,577 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:24:12,638 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:24:13,267 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:24:21,373 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:26:45,403 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:26:45,464 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:26:46,092 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:26:56,381 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:10,119 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:10,180 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:10,824 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:16,383 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:25,458 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:25,519 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:26,661 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:37,267 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:44,677 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:44,739 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:46,176 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:56,864 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:24,250 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:24,313 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:33:24,851 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:35,155 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:36:05,810 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:36:05,869 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:36:06,104 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:36:16,791 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local


On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
> Yes, the jps command gives me the following...
>
> on 172.16.4.120 ---
> 10160 SecondaryNameNode
> 9794 NameNode
> 9980 DataNode
> 9388 Jps
> 16267 JobTracker
>
> on 172.16.4.14 --
> 6812 Jps
> 4523 DataNode
>
>
> On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>> Hello Dibyendu,
>>
>>        Are you able to see anything at http://172.16.4.120:50030?What
>> does
>> JPS show on your terminal? Whatever logs you have posted here look
>> incomplete to me. Can you do a quick recheck?
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>> <[hidden email]>wrote:
>>
>>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>>> mode.
>>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>> HELP PLEASE...
>>>
>>> I'm using hadoop 1.0.3 version.
>>> I am using 2 computers -
>>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
>>> 172.16.4.14 - DATANODE
>>>
>>> My conf is somewhat -
>>> < core-site.xml >
>>> fs.default.name ------ hdfs://172.16.4.120:9001
>>> hadoop.tmp.dir ------
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>
>>> < hdfs-site.xml >
>>> dfs.replication -- 2
>>> dfs.name.dir ---
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>> dfs.data.dir --- /tmp/hadoop_data
>>>
>>> < mapred-site.xml >
>>> mapred.job.tracker --- 172.16.4.120:9002
>>>
>>> < slaves >
>>> 172.16.4.14
>>> 172.16.4.120
>>>
>>> < masters >
>>> 172.16.4.120
>>>
>>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:40:23,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:40:24,559 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:40:34,846 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>
>>> PLEASE HELP ANYONE...
>>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>> THANK YOU SO MUCH...
>>> --
>>> Dibyendu Karmakar,
>>> < [hidden email] >
>>>
>>
>
>
> --
> Dibyendu Karmakar,
> < [hidden email] >
>


--
Dibyendu Karmakar,
< [hidden email] >




--
Nitin Pawar

Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Robert Molina
Hi Dibyendu, 
I believe TT is trying to do some cleanup.  What is currently in 

/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local

Regards, 
Robert

On Tue, Dec 4, 2012 at 4:49 AM, Nitin Pawar <[hidden email]> wrote:
surprising to see that TT is restarting without any error after it checks for the directory ownership mapred local directories. 

can you try putting tasktracker startup in debug mode? (which version of JDK are you using? )


On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <[hidden email]> wrote:
I see. Could you please post your JT logs? Also, comment out "127.0.1.1" in your "/etc/hosts" and try to restart the cluster. I am assuming rest of the things are working fine.

(I am sorry as I am not able to post any direct answer, as it's very difficult to diagnose the actual problem without error logs).

Regards,
    Mohammad Tariq



On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <[hidden email]> wrote:
THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
ALSO --- THANK YOU FOR THE REPLY


2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:20:46,983 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:20:47,044 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:20:47,445 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:20:48,478 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:20:59,164 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:21:11,971 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:21:12,031 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:21:12,032 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:21:12,443 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:21:22,728 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:23:20,876 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:23:20,937 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:23:20,939 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:23:21,969 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:23:32,658 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:24:12,577 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:24:12,638 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:24:13,038 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:24:13,267 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:24:21,373 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:26:45,403 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:26:45,464 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:26:45,864 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:26:46,092 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:26:56,381 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:10,119 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:10,180 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:10,581 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:10,824 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:16,383 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:25,458 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:25,519 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:25,823 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:26,661 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:37,267 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:27:44,677 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:27:44,739 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:27:45,140 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:27:46,176 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:27:56,864 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:24,250 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:24,313 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:24,614 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:33:24,851 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:35,155 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:36:05,810 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:36:05,869 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:36:05,872 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:36:06,104 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:36:16,791 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:40:23,864 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:40:23,925 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:40:24,326 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
system started
2012-12-04 15:40:24,559 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:40:34,846 INFO
org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
truncater with mapRetainSize=-1 and reduceRetainSize=-1
2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
Starting tasktracker with owner as dibyendu_karmakar
2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
Good mapred local directories are:
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local


On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
> Yes, the jps command gives me the following...
>
> on 172.16.4.120 ---
> 10160 SecondaryNameNode
> 9794 NameNode
> 9980 DataNode
> 9388 Jps
> 16267 JobTracker
>
> on 172.16.4.14 --
> 6812 Jps
> 4523 DataNode
>
>
> On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>> Hello Dibyendu,
>>
>>        Are you able to see anything at http://172.16.4.120:50030?What
>> does
>> JPS show on your terminal? Whatever logs you have posted here look
>> incomplete to me. Can you do a quick recheck?
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>>
>> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>> <[hidden email]>wrote:
>>
>>> Hiii, I am new in hadoop. Trying to configure it in fully distributed
>>> mode.
>>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>> HELP PLEASE...
>>>
>>> I'm using hadoop 1.0.3 version.
>>> I am using 2 computers -
>>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER + DATANODE
>>> 172.16.4.14 - DATANODE
>>>
>>> My conf is somewhat -
>>> < core-site.xml >
>>> fs.default.name ------ hdfs://172.16.4.120:9001
>>> hadoop.tmp.dir ------
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>
>>> < hdfs-site.xml >
>>> dfs.replication -- 2
>>> dfs.name.dir ---
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>> dfs.data.dir --- /tmp/hadoop_data
>>>
>>> < mapred-site.xml >
>>> mapred.job.tracker --- 172.16.4.120:9002
>>>
>>> < slaves >
>>> 172.16.4.14
>>> 172.16.4.120
>>>
>>> < masters >
>>> 172.16.4.120
>>>
>>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>> STARTUP_MSG:
>>> /************************************************************
>>> STARTUP_MSG: Starting TaskTracker
>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>> STARTUP_MSG:   args = []
>>> STARTUP_MSG:   version = 1.0.3
>>> STARTUP_MSG:   build =
>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>> ************************************************************/
>>> 2012-12-04 15:40:23,864 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> MetricsSystem,sub=Stats registered.
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>> period at 10 second(s).
>>> 2012-12-04 15:40:24,326 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>> system started
>>> 2012-12-04 15:40:24,559 INFO
>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>> ugi registered.
>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>> org.mortbay.log.Slf4jLog
>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>> global filtersafety
>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>> 2012-12-04 15:40:34,846 INFO
>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Starting tasktracker with owner as dibyendu_karmakar
>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>> Good mapred local directories are:
>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>
>>> PLEASE HELP ANYONE...
>>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>> THANK YOU SO MUCH...
>>> --
>>> Dibyendu Karmakar,
>>> < [hidden email] >
>>>
>>
>
>
> --
> Dibyendu Karmakar,
> < [hidden email] >
>


--
Dibyendu Karmakar,
< [hidden email] >




--
Nitin Pawar


Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Dibyendu Karmakar
@ Nitin Power, I don't how to put Task Tracker in debug mode.

JDK VERSION - using "java -version" command
------------------------------------------------
java version "1.6.0"
Java(TM) SE Runtime Environment (build 1.6.0-b105)
Java HotSpot(TM) Client VM (build 1.6.0-b105, mixed mode, sharing)

@ Robert Molina,
doing "ls /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local"
gives a directory named "taskTracker"
But this directory is empty --- no file found after doing "ls" on this directory

AND ALSO MY < hadoop.tmp.dir > IS
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp


@ Mohammad Tariq,

THE JOB TRACKER LOG FILE IS AS FOLLOWS ---- NO ERROR ALSO

2012-12-04 15:33:20,305 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:20,768 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:20,780 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:20,880 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:20,880 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics
system started
2012-12-04 15:33:21,277 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
QueueMetrics,q=default registered.
2012-12-04 15:33:22,527 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:22,528 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2012-12-04 15:33:22,530 INFO org.apache.hadoop.mapred.JobTracker:
Scheduler configured with (memSizeForMapSlotOnJT,
memSizeForReduceSlotOnJT, limitMaxMemForMapTasks,
limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2012-12-04 15:33:22,531 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2012-12-04 15:33:22,537 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread,
tokenRemoverScanInterval=60 min(s)
2012-12-04 15:33:22,537 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2012-12-04 15:33:22,868 INFO org.apache.hadoop.mapred.JobTracker:
Starting jobtracker with owner as dibyendu_karmakar
2012-12-04 15:33:22,888 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort9002 registered.
2012-12-04 15:33:22,889 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort9002 registered.
2012-12-04 15:33:22,892 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2012-12-04 15:33:32,947 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:33,012 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:33,413 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open()
is -1. Opening the listener on 50030
2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50030
webServer.getConnectors()[0].getLocalPort() returned 50030
2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer: Jetty
bound to port 50030
2012-12-04 15:33:33,415 INFO org.mortbay.log: jetty-6.1.26
2012-12-04 15:33:34,274 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50030
2012-12-04 15:33:34,279 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
jvm registered.
2012-12-04 15:33:34,280 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
JobTrackerMetrics registered.
2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
JobTracker up at: 9002
2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
JobTracker webserver: 50030
2012-12-04 15:33:34,704 INFO org.apache.hadoop.mapred.JobTracker:
Cleaning up the system directory
2012-12-04 15:33:34,802 INFO org.apache.hadoop.mapred.JobTracker:
History server being initialized in embedded mode
2012-12-04 15:33:34,806 INFO
org.apache.hadoop.mapred.JobHistoryServer: Started job history server
at: localhost:50030
2012-12-04 15:33:34,806 INFO org.apache.hadoop.mapred.JobTracker: Job
History Server web address: localhost:50030
2012-12-04 15:33:34,810 INFO
org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store
is inactive
2012-12-04 15:33:35,426 INFO org.apache.hadoop.mapred.JobTracker:
Refreshing hosts information
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Setting the includes file to
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Setting the excludes file to
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2012-12-04 15:33:35,765 INFO org.apache.hadoop.mapred.JobTracker:
Decommissioning 0 nodes
2012-12-04 15:33:35,766 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.mapred.JobTracker:
Starting RUNNING
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 9002: starting


THANKS EVERYONE FOR THE REPLY...
IF YOU FIND ANYTHING, LET ME KNOW PLEASE...

IS THERE ANY PROBLEM WITH HADOOP VERSION 1.0.3 -----
THANKS AGAIN...

On 12/5/12, Robert Molina <[hidden email]> wrote:

> Hi Dibyendu,
> I believe TT is trying to do some cleanup.  What is currently in
>
> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>
> Regards,
> Robert
>
> On Tue, Dec 4, 2012 at 4:49 AM, Nitin Pawar <[hidden email]>
> wrote:
>
>> surprising to see that TT is restarting without any error after it checks
>> for the directory ownership mapred local directories.
>>
>> can you try putting tasktracker startup in debug mode? (which version of
>> JDK are you using? )
>>
>>
>> On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <[hidden email]>
>> wrote:
>>
>>> I see. Could you please post your JT logs? Also, comment out "127.0.1.1"
>>> in your "/etc/hosts" and try to restart the cluster. I am assuming rest
>>> of
>>> the things are working fine.
>>>
>>> (I am sorry as I am not able to post any direct answer, as it's very
>>> difficult to diagnose the actual problem without error logs).
>>>
>>> Regards,
>>>     Mohammad Tariq
>>>
>>>
>>>
>>> On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <
>>> [hidden email]> wrote:
>>>
>>>> THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
>>>> ALSO --- THANK YOU FOR THE REPLY
>>>>
>>>>
>>>> 2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:20:46,983 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:20:47,044 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:20:47,445 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:20:47,445 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:20:48,478 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:20:59,164 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:21:11,971 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:21:12,031 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:21:12,032 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:21:12,032 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:21:12,443 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:21:22,728 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:23:20,876 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:23:20,937 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:23:20,939 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:23:20,939 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:23:21,969 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:23:32,658 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:24:12,577 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:24:12,638 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:24:13,038 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:24:13,038 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:24:13,267 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:24:21,373 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:26:45,403 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:26:45,464 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:26:45,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:26:45,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:26:46,092 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:26:56,381 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:10,119 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:10,180 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:10,581 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:10,581 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:10,824 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:16,383 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:25,458 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:25,519 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:25,823 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:25,823 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:26,661 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:37,267 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:44,677 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:44,739 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:45,140 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:45,140 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:46,176 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:56,864 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:33:24,250 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:33:24,313 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:33:24,614 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:33:24,614 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:33:24,851 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:33:35,155 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:36:05,810 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:36:05,869 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:36:05,872 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:36:05,872 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:36:06,104 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:36:16,791 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:40:23,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:40:23,925 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:40:24,326 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:40:24,326 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:40:24,559 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:40:34,846 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>>
>>>>
>>>> On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
>>>> > Yes, the jps command gives me the following...
>>>> >
>>>> > on 172.16.4.120 ---
>>>> > 10160 SecondaryNameNode
>>>> > 9794 NameNode
>>>> > 9980 DataNode
>>>> > 9388 Jps
>>>> > 16267 JobTracker
>>>> >
>>>> > on 172.16.4.14 --
>>>> > 6812 Jps
>>>> > 4523 DataNode
>>>> >
>>>> >
>>>> > On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>>>> >> Hello Dibyendu,
>>>> >>
>>>> >>        Are you able to see anything at
>>>> >> http://172.16.4.120:50030?What
>>>> >> does
>>>> >> JPS show on your terminal? Whatever logs you have posted here look
>>>> >> incomplete to me. Can you do a quick recheck?
>>>> >>
>>>> >> Regards,
>>>> >>     Mohammad Tariq
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>>>> >> <[hidden email]>wrote:
>>>> >>
>>>> >>> Hiii, I am new in hadoop. Trying to configure it in fully
>>>> >>> distributed
>>>> >>> mode.
>>>> >>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>>> >>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>>> >>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>>> >>> HELP PLEASE...
>>>> >>>
>>>> >>> I'm using hadoop 1.0.3 version.
>>>> >>> I am using 2 computers -
>>>> >>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER +
>>>> DATANODE
>>>> >>> 172.16.4.14 - DATANODE
>>>> >>>
>>>> >>> My conf is somewhat -
>>>> >>> < core-site.xml >
>>>> >>> fs.default.name ------ hdfs://172.16.4.120:9001
>>>> >>> hadoop.tmp.dir ------
>>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>> >>>
>>>> >>> < hdfs-site.xml >
>>>> >>> dfs.replication -- 2
>>>> >>> dfs.name.dir ---
>>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>>> >>> dfs.data.dir --- /tmp/hadoop_data
>>>> >>>
>>>> >>> < mapred-site.xml >
>>>> >>> mapred.job.tracker --- 172.16.4.120:9002
>>>> >>>
>>>> >>> < slaves >
>>>> >>> 172.16.4.14
>>>> >>> 172.16.4.120
>>>> >>>
>>>> >>> < masters >
>>>> >>> 172.16.4.120
>>>> >>>
>>>> >>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>>> >>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>>> >>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> STARTUP_MSG:
>>>> >>> /************************************************************
>>>> >>> STARTUP_MSG: Starting TaskTracker
>>>> >>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> >>> STARTUP_MSG:   args = []
>>>> >>> STARTUP_MSG:   version = 1.0.3
>>>> >>> STARTUP_MSG:   build =
>>>> >>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0-r
>>>> >>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> >>> ************************************************************/
>>>> >>> 2012-12-04 15:40:23,864 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>>>> >>> from
>>>> >>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>>> source
>>>> >>> MetricsSystem,sub=Stats registered.
>>>> >>> 2012-12-04 15:40:24,326 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>>>> >>> snapshot
>>>> >>> period at 10 second(s).
>>>> >>> 2012-12-04 15:40:24,326 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>>>> metrics
>>>> >>> system started
>>>> >>> 2012-12-04 15:40:24,559 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>>> source
>>>> >>> ugi registered.
>>>> >>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>>> >>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> >>> org.mortbay.log.Slf4jLog
>>>> >>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer:
>>>> >>> Added
>>>> >>> global filtersafety
>>>> >>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> >>> 2012-12-04 15:40:34,846 INFO
>>>> >>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> >>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> >>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> Starting tasktracker with owner as dibyendu_karmakar
>>>> >>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> Good mapred local directories are:
>>>> >>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> >>>
>>>> >>> PLEASE HELP ANYONE...
>>>> >>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>>> >>> THANK YOU SO MUCH...
>>>> >>> --
>>>> >>> Dibyendu Karmakar,
>>>> >>> < [hidden email] >
>>>> >>>
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> > Dibyendu Karmakar,
>>>> > < [hidden email] >
>>>> >
>>>>
>>>>
>>>> --
>>>> Dibyendu Karmakar,
>>>> < [hidden email] >
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>


--
Dibyendu Karmakar,
< [hidden email] >
Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Robert Molina
Hi Dibyendu, 
Looking back at your logs, you are trying to start TT on the 120 box where your the master processes along with datanode is running.  I was wondering if you tried to launch TT on the 172.16.4.14 as well and get the same behavior. 

Regards, 
Robert

On Tue, Dec 4, 2012 at 11:32 PM, Dibyendu Karmakar <[hidden email]> wrote:
@ Nitin Power, I don't how to put Task Tracker in debug mode.

JDK VERSION - using "java -version" command
------------------------------------------------
java version "1.6.0"
Java(TM) SE Runtime Environment (build 1.6.0-b105)
Java HotSpot(TM) Client VM (build 1.6.0-b105, mixed mode, sharing)

@ Robert Molina,
doing "ls /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local"
gives a directory named "taskTracker"
But this directory is empty --- no file found after doing "ls" on this directory

AND ALSO MY < hadoop.tmp.dir > IS
/home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp


@ Mohammad Tariq,

THE JOB TRACKER LOG FILE IS AS FOLLOWS ---- NO ERROR ALSO

2012-12-04 15:33:20,305 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.0.3
STARTUP_MSG:   build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
************************************************************/
2012-12-04 15:33:20,768 INFO
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2012-12-04 15:33:20,780 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
MetricsSystem,sub=Stats registered.
2012-12-04 15:33:20,880 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
period at 10 second(s).
2012-12-04 15:33:20,880 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics
system started
2012-12-04 15:33:21,277 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
QueueMetrics,q=default registered.
2012-12-04 15:33:22,527 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
ugi registered.
2012-12-04 15:33:22,528 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2012-12-04 15:33:22,530 INFO org.apache.hadoop.mapred.JobTracker:
Scheduler configured with (memSizeForMapSlotOnJT,
memSizeForReduceSlotOnJT, limitMaxMemForMapTasks,
limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2012-12-04 15:33:22,531 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2012-12-04 15:33:22,537 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Starting expired delegation token remover thread,
tokenRemoverScanInterval=60 min(s)
2012-12-04 15:33:22,537 INFO
org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
Updating the current master key for generating delegation tokens
2012-12-04 15:33:22,868 INFO org.apache.hadoop.mapred.JobTracker:
Starting jobtracker with owner as dibyendu_karmakar
2012-12-04 15:33:22,888 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcDetailedActivityForPort9002 registered.
2012-12-04 15:33:22,889 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
RpcActivityForPort9002 registered.
2012-12-04 15:33:22,892 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2012-12-04 15:33:32,947 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-12-04 15:33:33,012 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-12-04 15:33:33,413 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open()
is -1. Opening the listener on 50030
2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50030
webServer.getConnectors()[0].getLocalPort() returned 50030
2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer: Jetty
bound to port 50030
2012-12-04 15:33:33,415 INFO org.mortbay.log: jetty-6.1.26
2012-12-04 15:33:34,274 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50030
2012-12-04 15:33:34,279 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
jvm registered.
2012-12-04 15:33:34,280 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
JobTrackerMetrics registered.
2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
JobTracker up at: 9002
2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
JobTracker webserver: 50030
2012-12-04 15:33:34,704 INFO org.apache.hadoop.mapred.JobTracker:
Cleaning up the system directory
2012-12-04 15:33:34,802 INFO org.apache.hadoop.mapred.JobTracker:
History server being initialized in embedded mode
2012-12-04 15:33:34,806 INFO
org.apache.hadoop.mapred.JobHistoryServer: Started job history server
at: localhost:50030
2012-12-04 15:33:34,806 INFO org.apache.hadoop.mapred.JobTracker: Job
History Server web address: localhost:50030
2012-12-04 15:33:34,810 INFO
org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store
is inactive
2012-12-04 15:33:35,426 INFO org.apache.hadoop.mapred.JobTracker:
Refreshing hosts information
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Setting the includes file to
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Setting the excludes file to
2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
Refreshing hosts (include/exclude) list
2012-12-04 15:33:35,765 INFO org.apache.hadoop.mapred.JobTracker:
Decommissioning 0 nodes
2012-12-04 15:33:35,766 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 9002: starting
2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 9002: starting
2012-12-04 15:33:35,768 INFO org.apache.hadoop.mapred.JobTracker:
Starting RUNNING
2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 9002: starting


THANKS EVERYONE FOR THE REPLY...
IF YOU FIND ANYTHING, LET ME KNOW PLEASE...

IS THERE ANY PROBLEM WITH HADOOP VERSION 1.0.3 -----
THANKS AGAIN...

On 12/5/12, Robert Molina <[hidden email]> wrote:
> Hi Dibyendu,
> I believe TT is trying to do some cleanup.  What is currently in
>
> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>
> Regards,
> Robert
>
> On Tue, Dec 4, 2012 at 4:49 AM, Nitin Pawar <[hidden email]>
> wrote:
>
>> surprising to see that TT is restarting without any error after it checks
>> for the directory ownership mapred local directories.
>>
>> can you try putting tasktracker startup in debug mode? (which version of
>> JDK are you using? )
>>
>>
>> On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <[hidden email]>
>> wrote:
>>
>>> I see. Could you please post your JT logs? Also, comment out "127.0.1.1"
>>> in your "/etc/hosts" and try to restart the cluster. I am assuming rest
>>> of
>>> the things are working fine.
>>>
>>> (I am sorry as I am not able to post any direct answer, as it's very
>>> difficult to diagnose the actual problem without error logs).
>>>
>>> Regards,
>>>     Mohammad Tariq
>>>
>>>
>>>
>>> On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <
>>> [hidden email]> wrote:
>>>
>>>> THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
>>>> ALSO --- THANK YOU FOR THE REPLY
>>>>
>>>>
>>>> 2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:20:46,983 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:20:47,044 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:20:47,445 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:20:47,445 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:20:48,478 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:20:59,164 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:21:11,971 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:21:12,031 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:21:12,032 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:21:12,032 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:21:12,443 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:21:22,728 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:23:20,876 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:23:20,937 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:23:20,939 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:23:20,939 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:23:21,969 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:23:32,658 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:24:12,577 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:24:12,638 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:24:13,038 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:24:13,038 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:24:13,267 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:24:21,373 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:26:45,403 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:26:45,464 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:26:45,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:26:45,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:26:46,092 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:26:56,381 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:10,119 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:10,180 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:10,581 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:10,581 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:10,824 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:16,383 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:25,458 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:25,519 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:25,823 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:25,823 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:26,661 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:37,267 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:27:44,677 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:27:44,739 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:27:45,140 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:27:45,140 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:27:46,176 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:27:56,864 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:33:24,250 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:33:24,313 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:33:24,614 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:33:24,614 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:33:24,851 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:33:35,155 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:36:05,810 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:36:05,869 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:36:05,872 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:36:05,872 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:36:06,104 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:36:16,791 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> STARTUP_MSG:
>>>> /************************************************************
>>>> STARTUP_MSG: Starting TaskTracker
>>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> STARTUP_MSG:   args = []
>>>> STARTUP_MSG:   version = 1.0.3
>>>> STARTUP_MSG:   build =
>>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> ************************************************************/
>>>> 2012-12-04 15:40:23,864 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>>>> hadoop-metrics2.properties
>>>> 2012-12-04 15:40:23,925 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> MetricsSystem,sub=Stats registered.
>>>> 2012-12-04 15:40:24,326 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>>>> period at 10 second(s).
>>>> 2012-12-04 15:40:24,326 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics
>>>> system started
>>>> 2012-12-04 15:40:24,559 INFO
>>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>>>> ugi registered.
>>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> org.mortbay.log.Slf4jLog
>>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer: Added
>>>> global filtersafety
>>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> 2012-12-04 15:40:34,846 INFO
>>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Starting tasktracker with owner as dibyendu_karmakar
>>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> Good mapred local directories are:
>>>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>>
>>>>
>>>> On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
>>>> > Yes, the jps command gives me the following...
>>>> >
>>>> > on 172.16.4.120 ---
>>>> > 10160 SecondaryNameNode
>>>> > 9794 NameNode
>>>> > 9980 DataNode
>>>> > 9388 Jps
>>>> > 16267 JobTracker
>>>> >
>>>> > on 172.16.4.14 --
>>>> > 6812 Jps
>>>> > 4523 DataNode
>>>> >
>>>> >
>>>> > On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>>>> >> Hello Dibyendu,
>>>> >>
>>>> >>        Are you able to see anything at
>>>> >> http://172.16.4.120:50030?What
>>>> >> does
>>>> >> JPS show on your terminal? Whatever logs you have posted here look
>>>> >> incomplete to me. Can you do a quick recheck?
>>>> >>
>>>> >> Regards,
>>>> >>     Mohammad Tariq
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>>>> >> <[hidden email]>wrote:
>>>> >>
>>>> >>> Hiii, I am new in hadoop. Trying to configure it in fully
>>>> >>> distributed
>>>> >>> mode.
>>>> >>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>>>> >>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING DOWN
>>>> >>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>>>> >>> HELP PLEASE...
>>>> >>>
>>>> >>> I'm using hadoop 1.0.3 version.
>>>> >>> I am using 2 computers -
>>>> >>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER +
>>>> DATANODE
>>>> >>> 172.16.4.14 - DATANODE
>>>> >>>
>>>> >>> My conf is somewhat -
>>>> >>> < core-site.xml >
>>>> >>> fs.default.name ------ hdfs://172.16.4.120:9001
>>>> >>> hadoop.tmp.dir ------
>>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>>> >>>
>>>> >>> < hdfs-site.xml >
>>>> >>> dfs.replication -- 2
>>>> >>> dfs.name.dir ---
>>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>>>> >>> dfs.data.dir --- /tmp/hadoop_data
>>>> >>>
>>>> >>> < mapred-site.xml >
>>>> >>> mapred.job.tracker --- 172.16.4.120:9002
>>>> >>>
>>>> >>> < slaves >
>>>> >>> 172.16.4.14
>>>> >>> 172.16.4.120
>>>> >>>
>>>> >>> < masters >
>>>> >>> 172.16.4.120
>>>> >>>
>>>> >>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>>>> >>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log >
>>>> >>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> STARTUP_MSG:
>>>> >>> /************************************************************
>>>> >>> STARTUP_MSG: Starting TaskTracker
>>>> >>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>>>> >>> STARTUP_MSG:   args = []
>>>> >>> STARTUP_MSG:   version = 1.0.3
>>>> >>> STARTUP_MSG:   build =
>>>> >>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0-r
>>>> >>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>>>> >>> ************************************************************/
>>>> >>> 2012-12-04 15:40:23,864 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>>>> >>> from
>>>> >>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>>> source
>>>> >>> MetricsSystem,sub=Stats registered.
>>>> >>> 2012-12-04 15:40:24,326 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>>>> >>> snapshot
>>>> >>> period at 10 second(s).
>>>> >>> 2012-12-04 15:40:24,326 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>>>> metrics
>>>> >>> system started
>>>> >>> 2012-12-04 15:40:24,559 INFO
>>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>>>> source
>>>> >>> ugi registered.
>>>> >>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>>>> >>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>>>> >>> org.mortbay.log.Slf4jLog
>>>> >>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer:
>>>> >>> Added
>>>> >>> global filtersafety
>>>> >>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>>>> >>> 2012-12-04 15:40:34,846 INFO
>>>> >>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>>>> >>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>>>> >>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> Starting tasktracker with owner as dibyendu_karmakar
>>>> >>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>>>> >>> Good mapred local directories are:
>>>> >>>
>>>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>>>> >>>
>>>> >>> PLEASE HELP ANYONE...
>>>> >>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>>>> >>> THANK YOU SO MUCH...
>>>> >>> --
>>>> >>> Dibyendu Karmakar,
>>>> >>> < [hidden email] >
>>>> >>>
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> > Dibyendu Karmakar,
>>>> > < [hidden email] >
>>>> >
>>>>
>>>>
>>>> --
>>>> Dibyendu Karmakar,
>>>> < [hidden email] >
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>>
>


--
Dibyendu Karmakar,
< [hidden email] >

Reply | Threaded
Open this post in threaded view
|

Re: Task Tracker Not Starting in Hadoop-1.0.3 Help Please

Dibyendu Karmakar
@ Robert,
I was trying the same in 172.16.4.14 and it was not running as well.
Tasktracker is not running at all.
I am using hadoop-1.0.3

But yesterday, I tried the old hadoop-0.22.0 and every daemon,
including tasktracker is running quite beautifully....
Actually, I am trying to understand the code for hadoop... so the
purpose is to run the WordCount program given in MapReduce Example...
But I cann't complie this program in hadoop-0.22.0 because
hadoop-core-version.jar is not there in hadoop-0.22.0 whereas it is in
hadoop-1.0.3 and compilation is successful...

THANKS FOR YOUR CONSTANT REPLY..
DON'T KNOW WHAT I'LL DO IN MY PROJECT ON HADOOP.
THANKS AGAIN...

On 12/6/12, Robert Molina <[hidden email]> wrote:

> Hi Dibyendu,
> Looking back at your logs, you are trying to start TT on the 120 box where
> your the master processes along with datanode is running.  I was wondering
> if you tried to launch TT on the 172.16.4.14 as well and get the same
> behavior.
>
> Regards,
> Robert
>
> On Tue, Dec 4, 2012 at 11:32 PM, Dibyendu Karmakar
> <[hidden email]>wrote:
>
>> @ Nitin Power, I don't how to put Task Tracker in debug mode.
>>
>> JDK VERSION - using "java -version" command
>> ------------------------------------------------
>> java version "1.6.0"
>> Java(TM) SE Runtime Environment (build 1.6.0-b105)
>> Java HotSpot(TM) Client VM (build 1.6.0-b105, mixed mode, sharing)
>>
>> @ Robert Molina,
>> doing "ls
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local"
>> gives a directory named "taskTracker"
>> But this directory is empty --- no file found after doing "ls" on this
>> directory
>>
>> AND ALSO MY < hadoop.tmp.dir > IS
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>>
>>
>> @ Mohammad Tariq,
>>
>> THE JOB TRACKER LOG FILE IS AS FOLLOWS ---- NO ERROR ALSO
>>
>> 2012-12-04 15:33:20,305 INFO org.apache.hadoop.mapred.JobTracker:
>> STARTUP_MSG:
>> /************************************************************
>> STARTUP_MSG: Starting JobTracker
>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> STARTUP_MSG:   args = []
>> STARTUP_MSG:   version = 1.0.3
>> STARTUP_MSG:   build =
>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> ************************************************************/
>> 2012-12-04 15:33:20,768 INFO
>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
>> hadoop-metrics2.properties
>> 2012-12-04 15:33:20,780 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> MetricsSystem,sub=Stats registered.
>> 2012-12-04 15:33:20,880 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
>> period at 10 second(s).
>> 2012-12-04 15:33:20,880 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: JobTracker metrics
>> system started
>> 2012-12-04 15:33:21,277 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> QueueMetrics,q=default registered.
>> 2012-12-04 15:33:22,527 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> ugi registered.
>> 2012-12-04 15:33:22,528 INFO
>>
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>> 2012-12-04 15:33:22,530 INFO org.apache.hadoop.mapred.JobTracker:
>> Scheduler configured with (memSizeForMapSlotOnJT,
>> memSizeForReduceSlotOnJT, limitMaxMemForMapTasks,
>> limitMaxMemForReduceTasks) (-1, -1, -1, -1)
>> 2012-12-04 15:33:22,531 INFO org.apache.hadoop.util.HostsFileReader:
>> Refreshing hosts (include/exclude) list
>> 2012-12-04 15:33:22,537 INFO
>>
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Starting expired delegation token remover thread,
>> tokenRemoverScanInterval=60 min(s)
>> 2012-12-04 15:33:22,537 INFO
>>
>> org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager:
>> Updating the current master key for generating delegation tokens
>> 2012-12-04 15:33:22,868 INFO org.apache.hadoop.mapred.JobTracker:
>> Starting jobtracker with owner as dibyendu_karmakar
>> 2012-12-04 15:33:22,888 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> RpcDetailedActivityForPort9002 registered.
>> 2012-12-04 15:33:22,889 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> RpcActivityForPort9002 registered.
>> 2012-12-04 15:33:22,892 INFO org.apache.hadoop.ipc.Server: Starting
>> SocketReader
>> 2012-12-04 15:33:32,947 INFO org.mortbay.log: Logging to
>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> org.mortbay.log.Slf4jLog
>> 2012-12-04 15:33:33,012 INFO org.apache.hadoop.http.HttpServer: Added
>> global filtersafety
>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> 2012-12-04 15:33:33,413 INFO org.apache.hadoop.http.HttpServer: Port
>> returned by webServer.getConnectors()[0].getLocalPort() before open()
>> is -1. Opening the listener on 50030
>> 2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer:
>> listener.getLocalPort() returned 50030
>> webServer.getConnectors()[0].getLocalPort() returned 50030
>> 2012-12-04 15:33:33,415 INFO org.apache.hadoop.http.HttpServer: Jetty
>> bound to port 50030
>> 2012-12-04 15:33:33,415 INFO org.mortbay.log: jetty-6.1.26
>> 2012-12-04 15:33:34,274 INFO org.mortbay.log: Started
>> SelectChannelConnector@0.0.0.0:50030
>> 2012-12-04 15:33:34,279 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> jvm registered.
>> 2012-12-04 15:33:34,280 INFO
>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
>> JobTrackerMetrics registered.
>> 2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
>> JobTracker up at: 9002
>> 2012-12-04 15:33:34,280 INFO org.apache.hadoop.mapred.JobTracker:
>> JobTracker webserver: 50030
>> 2012-12-04 15:33:34,704 INFO org.apache.hadoop.mapred.JobTracker:
>> Cleaning up the system directory
>> 2012-12-04 15:33:34,802 INFO org.apache.hadoop.mapred.JobTracker:
>> History server being initialized in embedded mode
>> 2012-12-04 15:33:34,806 INFO
>> org.apache.hadoop.mapred.JobHistoryServer: Started job history server
>> at: localhost:50030
>> 2012-12-04 15:33:34,806 INFO org.apache.hadoop.mapred.JobTracker: Job
>> History Server web address: localhost:50030
>> 2012-12-04 15:33:34,810 INFO
>> org.apache.hadoop.mapred.CompletedJobStatusStore: Completed job store
>> is inactive
>> 2012-12-04 15:33:35,426 INFO org.apache.hadoop.mapred.JobTracker:
>> Refreshing hosts information
>> 2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
>> Setting the includes file to
>> 2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
>> Setting the excludes file to
>> 2012-12-04 15:33:35,765 INFO org.apache.hadoop.util.HostsFileReader:
>> Refreshing hosts (include/exclude) list
>> 2012-12-04 15:33:35,765 INFO org.apache.hadoop.mapred.JobTracker:
>> Decommissioning 0 nodes
>> 2012-12-04 15:33:35,766 INFO org.apache.hadoop.ipc.Server: IPC Server
>> Responder: starting
>> 2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
>> listener on 9002: starting
>> 2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 0 on 9002: starting
>> 2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 1 on 9002: starting
>> 2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 2 on 9002: starting
>> 2012-12-04 15:33:35,767 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 3 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 4 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 5 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 6 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 7 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 8 on 9002: starting
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.mapred.JobTracker:
>> Starting RUNNING
>> 2012-12-04 15:33:35,768 INFO org.apache.hadoop.ipc.Server: IPC Server
>> handler 9 on 9002: starting
>>
>>
>> THANKS EVERYONE FOR THE REPLY...
>> IF YOU FIND ANYTHING, LET ME KNOW PLEASE...
>>
>> IS THERE ANY PROBLEM WITH HADOOP VERSION 1.0.3 -----
>> THANKS AGAIN...
>>
>> On 12/5/12, Robert Molina <[hidden email]> wrote:
>> > Hi Dibyendu,
>> > I believe TT is trying to do some cleanup.  What is currently in
>> >
>> >
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >
>> > Regards,
>> > Robert
>> >
>> > On Tue, Dec 4, 2012 at 4:49 AM, Nitin Pawar <[hidden email]>
>> > wrote:
>> >
>> >> surprising to see that TT is restarting without any error after it
>> checks
>> >> for the directory ownership mapred local directories.
>> >>
>> >> can you try putting tasktracker startup in debug mode? (which version
>> >> of
>> >> JDK are you using? )
>> >>
>> >>
>> >> On Tue, Dec 4, 2012 at 4:59 PM, Mohammad Tariq <[hidden email]>
>> >> wrote:
>> >>
>> >>> I see. Could you please post your JT logs? Also, comment out
>> "127.0.1.1"
>> >>> in your "/etc/hosts" and try to restart the cluster. I am assuming
>> >>> rest
>> >>> of
>> >>> the things are working fine.
>> >>>
>> >>> (I am sorry as I am not able to post any direct answer, as it's very
>> >>> difficult to diagnose the actual problem without error logs).
>> >>>
>> >>> Regards,
>> >>>     Mohammad Tariq
>> >>>
>> >>>
>> >>>
>> >>> On Tue, Dec 4, 2012 at 4:31 PM, Dibyendu Karmakar <
>> >>> [hidden email]> wrote:
>> >>>
>> >>>> THE ENTIRE CONTENT OF TASKTRACKER -- PASTED HERE WITH AN ATTACHMENT
>> >>>> ALSO --- THANK YOU FOR THE REPLY
>> >>>>
>> >>>>
>> >>>> 2012-12-04 15:20:45,942 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:20:46,983 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:20:47,044 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:20:47,445 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:20:47,445 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:20:48,478 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:20:59,066 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:20:59,137 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:20:59,164 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:20:59,167 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:20:59,169 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:21:11,190 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:21:11,971 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:21:12,031 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:21:12,032 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:21:12,032 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:21:12,443 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:21:22,630 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:21:22,701 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:21:22,728 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:21:22,732 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:21:22,733 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:23:20,474 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:23:20,876 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:23:20,937 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:23:20,939 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:23:20,939 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:23:21,969 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:23:32,560 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:23:32,631 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:23:32,658 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:23:32,661 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:23:32,663 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:24:11,542 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:24:12,577 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:24:12,638 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:24:13,038 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:24:13,038 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:24:13,267 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:24:21,276 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:24:21,346 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:24:21,373 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:24:21,377 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:24:21,378 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:26:44,362 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:26:45,403 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:26:45,464 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:26:45,864 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:26:45,864 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:26:46,092 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:26:56,281 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:26:56,354 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:26:56,381 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:26:56,384 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:26:56,385 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:27:09,086 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:27:10,119 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:27:10,180 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:27:10,581 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:27:10,581 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:27:10,824 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:27:16,285 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:27:16,353 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:27:16,383 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:27:16,386 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:27:16,387 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:27:24,520 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:27:25,458 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:27:25,519 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:27:25,823 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:27:25,823 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:27:26,661 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:27:37,169 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:27:37,240 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:27:37,267 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:27:37,270 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:27:37,271 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:27:43,644 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:27:44,677 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:27:44,739 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:27:45,140 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:27:45,140 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:27:46,176 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:27:56,767 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:27:56,837 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:27:56,864 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:27:56,867 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:27:56,868 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:33:23,414 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:33:24,250 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:33:24,313 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:33:24,614 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:33:24,614 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:33:24,851 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:33:35,039 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:33:35,111 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:33:35,155 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:33:35,158 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:33:35,160 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:36:04,787 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:36:05,810 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:36:05,869 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:36:05,872 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:36:05,872 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:36:06,104 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:36:16,693 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:36:16,764 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:36:16,791 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:36:16,794 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:36:16,796 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> 2012-12-04 15:40:22,831 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> STARTUP_MSG:
>> >>>> /************************************************************
>> >>>> STARTUP_MSG: Starting TaskTracker
>> >>>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> STARTUP_MSG:   args = []
>> >>>> STARTUP_MSG:   version = 1.0.3
>> >>>> STARTUP_MSG:   build =
>> >>>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0
>> >>>> -r
>> >>>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> ************************************************************/
>> >>>> 2012-12-04 15:40:23,864 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> from
>> >>>> hadoop-metrics2.properties
>> >>>> 2012-12-04 15:40:23,925 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> MetricsSystem,sub=Stats registered.
>> >>>> 2012-12-04 15:40:24,326 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> snapshot
>> >>>> period at 10 second(s).
>> >>>> 2012-12-04 15:40:24,326 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> system started
>> >>>> 2012-12-04 15:40:24,559 INFO
>> >>>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> ugi registered.
>> >>>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>> >>>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> org.mortbay.log.Slf4jLog
>> >>>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer:
>> >>>> Added
>> >>>> global filtersafety
>> >>>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> 2012-12-04 15:40:34,846 INFO
>> >>>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> 2012-12-04 15:40:34,849 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> 2012-12-04 15:40:34,850 INFO org.apache.hadoop.mapred.TaskTracker:
>> >>>> Good mapred local directories are:
>> >>>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>>
>> >>>>
>> >>>> On 12/4/12, Dibyendu Karmakar <[hidden email]> wrote:
>> >>>> > Yes, the jps command gives me the following...
>> >>>> >
>> >>>> > on 172.16.4.120 ---
>> >>>> > 10160 SecondaryNameNode
>> >>>> > 9794 NameNode
>> >>>> > 9980 DataNode
>> >>>> > 9388 Jps
>> >>>> > 16267 JobTracker
>> >>>> >
>> >>>> > on 172.16.4.14 --
>> >>>> > 6812 Jps
>> >>>> > 4523 DataNode
>> >>>> >
>> >>>> >
>> >>>> > On 12/4/12, Mohammad Tariq <[hidden email]> wrote:
>> >>>> >> Hello Dibyendu,
>> >>>> >>
>> >>>> >>        Are you able to see anything at
>> >>>> >> http://172.16.4.120:50030?What
>> >>>> >> does
>> >>>> >> JPS show on your terminal? Whatever logs you have posted here
>> >>>> >> look
>> >>>> >> incomplete to me. Can you do a quick recheck?
>> >>>> >>
>> >>>> >> Regards,
>> >>>> >>     Mohammad Tariq
>> >>>> >>
>> >>>> >>
>> >>>> >>
>> >>>> >> On Tue, Dec 4, 2012 at 3:55 PM, Dibyendu Karmakar
>> >>>> >> <[hidden email]>wrote:
>> >>>> >>
>> >>>> >>> Hiii, I am new in hadoop. Trying to configure it in fully
>> >>>> >>> distributed
>> >>>> >>> mode.
>> >>>> >>> But after the command bin/start-all.sh or bin/start-mapred.sh or
>> >>>> >>> bin/hadoop-daemon.sh start tasktracker, TASKTRACKER IS GOING
>> >>>> >>> DOWN
>> >>>> >>> IMMEDIATELY WITHOUT ANY ERROR IN LOG FILE.
>> >>>> >>> HELP PLEASE...
>> >>>> >>>
>> >>>> >>> I'm using hadoop 1.0.3 version.
>> >>>> >>> I am using 2 computers -
>> >>>> >>> 172.16.4.12 (radix.itd.jusl.ac.in) - NAMENODE + JOBTRACKER +
>> >>>> DATANODE
>> >>>> >>> 172.16.4.14 - DATANODE
>> >>>> >>>
>> >>>> >>> My conf is somewhat -
>> >>>> >>> < core-site.xml >
>> >>>> >>> fs.default.name ------ hdfs://172.16.4.120:9001
>> >>>> >>> hadoop.tmp.dir ------
>> >>>> >>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp
>> >>>> >>>
>> >>>> >>> < hdfs-site.xml >
>> >>>> >>> dfs.replication -- 2
>> >>>> >>> dfs.name.dir ---
>> >>>> >>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/hadoop_name
>> >>>> >>> dfs.data.dir --- /tmp/hadoop_data
>> >>>> >>>
>> >>>> >>> < mapred-site.xml >
>> >>>> >>> mapred.job.tracker --- 172.16.4.120:9002
>> >>>> >>>
>> >>>> >>> < slaves >
>> >>>> >>> 172.16.4.14
>> >>>> >>> 172.16.4.120
>> >>>> >>>
>> >>>> >>> < masters >
>> >>>> >>> 172.16.4.120
>> >>>> >>>
>> >>>> >>> TASKTRACKER LOG FILE WITH NO ERROR -- ONLY INFO IS WRITTEN.
>> >>>> >>> < hadoop-dibyendu_karmakar-tasktracker-radix.itd.jusl.ac.in.log
>> >>>> >>> >
>> >>>> >>> 2012-12-04 15:40:22,831 INFO
>> >>>> >>> org.apache.hadoop.mapred.TaskTracker:
>> >>>> >>> STARTUP_MSG:
>> >>>> >>> /************************************************************
>> >>>> >>> STARTUP_MSG: Starting TaskTracker
>> >>>> >>> STARTUP_MSG:   host = radix.itd.jusl.ac.in/172.16.4.120
>> >>>> >>> STARTUP_MSG:   args = []
>> >>>> >>> STARTUP_MSG:   version = 1.0.3
>> >>>> >>> STARTUP_MSG:   build =
>> >>>> >>>
>> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0-r
>> >>>> >>> 1335192; compiled by 'hortonfo' on Tue May  8 20:31:25 UTC 2012
>> >>>> >>> ************************************************************/
>> >>>> >>> 2012-12-04 15:40:23,864 INFO
>> >>>> >>> org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
>> >>>> >>> from
>> >>>> >>> hadoop-metrics2.properties2012-12-04 15:40:23,925 INFO
>> >>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> >>> MetricsSystem,sub=Stats registered.
>> >>>> >>> 2012-12-04 15:40:24,326 INFO
>> >>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
>> >>>> >>> snapshot
>> >>>> >>> period at 10 second(s).
>> >>>> >>> 2012-12-04 15:40:24,326 INFO
>> >>>> >>> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker
>> >>>> metrics
>> >>>> >>> system started
>> >>>> >>> 2012-12-04 15:40:24,559 INFO
>> >>>> >>> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for
>> >>>> source
>> >>>> >>> ugi registered.
>> >>>> >>> 2012-12-04 15:40:34,747 INFO org.mortbay.log: Logging to
>> >>>> >>> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
>> >>>> >>> org.mortbay.log.Slf4jLog
>> >>>> >>> 2012-12-04 15:40:34,819 INFO org.apache.hadoop.http.HttpServer:
>> >>>> >>> Added
>> >>>> >>> global filtersafety
>> >>>> >>> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
>> >>>> >>> 2012-12-04 15:40:34,846 INFO
>> >>>> >>> org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs'
>> >>>> >>> truncater with mapRetainSize=-1 and reduceRetainSize=-1
>> >>>> >>> 2012-12-04 15:40:34,849 INFO
>> >>>> >>> org.apache.hadoop.mapred.TaskTracker:
>> >>>> >>> Starting tasktracker with owner as dibyendu_karmakar
>> >>>> >>> 2012-12-04 15:40:34,850 INFO
>> >>>> >>> org.apache.hadoop.mapred.TaskTracker:
>> >>>> >>> Good mapred local directories are:
>> >>>> >>>
>> >>>>
>> /home/usr/student/pg/yr11/dibyendu_karmakar/hadoop-1.0.3/temp/mapred/local
>> >>>> >>>
>> >>>> >>> PLEASE HELP ANYONE...
>> >>>> >>> IS THERE ANY CONFIGURATION NEEDED FOR TASKTRACKER?
>> >>>> >>> THANK YOU SO MUCH...
>> >>>> >>> --
>> >>>> >>> Dibyendu Karmakar,
>> >>>> >>> < [hidden email] >
>> >>>> >>>
>> >>>> >>
>> >>>> >
>> >>>> >
>> >>>> > --
>> >>>> > Dibyendu Karmakar,
>> >>>> > < [hidden email] >
>> >>>> >
>> >>>>
>> >>>>
>> >>>> --
>> >>>> Dibyendu Karmakar,
>> >>>> < [hidden email] >
>> >>>>
>> >>>
>> >>>
>> >>
>> >>
>> >> --
>> >> Nitin Pawar
>> >>
>> >>
>> >
>>
>>
>> --
>> Dibyendu Karmakar,
>> < [hidden email] >
>>
>


--
Dibyendu Karmakar,
< [hidden email] >