Cloudera
CCD-410 · Question #24
In a large MapReduce job with m mappers and n reducers, how many distinct copy operations will there be in the sort/shuffle phase?
The correct answer is A. mXn (i.e., m multiplied by n). A MapReduce job with m mappers and r reducers involves up to m * r distinct copy operations, since each mapper may have intermediate output going to every reducer.
Performance Tuning and Troubleshooting
Question
In a large MapReduce job with m mappers and n reducers, how many distinct copy operations will there be in the sort/shuffle phase?
Options
- AmXn (i.e., m multiplied by n)
- Bn
- Cm
- Dm+n (i.e., m plus n)
- Emn (i.e., m to the power of n)
How the community answered
(28 responses)- A75% (21)
- C7% (2)
- D4% (1)
- E14% (4)
Explanation
A MapReduce job with m mappers and r reducers involves up to m * r distinct copy operations, since each mapper may have intermediate output going to every reducer.
Topics
#shuffle phase#copy operations#mappers#reducers
Community Discussion
No community discussion yet for this question.