MapReduce Job State: PREP over 8 hours, state no change

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

MapReduce Job State: PREP over 8 hours, state no change

Ascot Moss
Hi,

I have submitted a mapreduce  job, and can find it from job list, however I find its STATE is PREP over last 8 hours, any idea why it takes so long to "PREP"?

regards



(mapred job -list)

                  JobId     State     StartTime     UserName       Queue   Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem   AM info

 job_1470075140254_0003       PREP 1470402873895



Reply | Threaded
Open this post in threaded view
|

Re: MapReduce Job State: PREP over 8 hours, state no change

Ravi Prakash-3
That's unusual. Are you able to submit a simple sleep job? You can do this using:

yarn jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-*-tests.jar sleep -m 1 -r 1

This should finish it in under a minute. Otherwise I'd suspect that your cluster is misconfigured.

HTH
Ravi

On Fri, Aug 5, 2016 at 7:11 PM, Ascot Moss <[hidden email]> wrote:
Hi,

I have submitted a mapreduce  job, and can find it from job list, however I find its STATE is PREP over last 8 hours, any idea why it takes so long to "PREP"?

regards



(mapred job -list)

                  JobId     State     StartTime     UserName       Queue   Priority UsedContainers RsvdContainers UsedMem RsvdMem NeededMem   AM info

 job_1470075140254_0003       PREP 1470402873895