Pause between tasks or jobs?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Pause between tasks or jobs?

xeonmailinglist-gmail

I am looking for a way to pause a chained job or a chained task. I want to do this because I want to validate the output of each map or reduce phase, or between each job execution. Is it possible to pause the execution of chained jobs or chained mappers or reducers in MapReduce V2. I was looking for the ChainedMapper and ChainedReducer, but I haven't found anything that could allow me to pause the execution.

Reply | Threaded
Open this post in threaded view
|

Re: Pause between tasks or jobs?

sreebalineni .

Just curious to understand if map reduce is right strategy for this scenario


On Aug 12, 2016 1:18 AM, "xeon Mailinglist" <[hidden email]> wrote:

I am looking for a way to pause a chained job or a chained task. I want to do this because I want to validate the output of each map or reduce phase, or between each job execution. Is it possible to pause the execution of chained jobs or chained mappers or reducers in MapReduce V2. I was looking for the ChainedMapper and ChainedReducer, but I haven't found anything that could allow me to pause the execution.