stop generating these "part-XXXX" empty files when using MultipleOutputs in mapreduce job

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

stop generating these "part-XXXX" empty files when using MultipleOutputs in mapreduce job

S. Zhou
I use MultipleOutputs so the output data are no longer stored in files "part-XXX". But they are still generated (though empty). Is it possible to stop generating these files when running MR job? (BTW, my MR job only has mapper). Thanks

Senqiang

Reply | Threaded
Open this post in threaded view
|

Re: stop generating these "part-XXXX" empty files when using MultipleOutputs in mapreduce job

Niels Basjes


On Mon, Oct 28, 2013 at 8:11 PM, S. Zhou <[hidden email]> wrote:
I use MultipleOutputs so the output data are no longer stored in files "part-XXX". But they are still generated (though empty). Is it possible to stop generating these files when running MR job? (BTW, my MR job only has mapper). Thanks

Senqiang




--
Best regards / Met vriendelijke groeten,

Niels Basjes