Shuffle Time Statistics (Hadoop 0.21)

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Shuffle Time Statistics (Hadoop 0.21)

Felix Halim

Where can I find the statistics that tells how long the shuffling time is?

I've looked at the Web UI and found "Slots Millis Maps" and "Slots
Millis Reduces".
But no shuffling timing...

Hadoop 0.21 seems to have more internal counters...
Where can I find the list of all Hadoop framework's counters?
I cannot find any documentation for these counters.

Felix Halim