Cloudera
CCD-333 · Question #61
You've written a MapReduce job that will process 500 million input records and generate 500 million key-value pairs. The data is not uniformly distributed. Your MapReduce job will create a…
The correct answer is E. Combiner. See the full explanation below for the reasoning.
Question
You've written a MapReduce job that will process 500 million input records and generate 500 million key-value pairs. The data is not uniformly distributed. Your MapReduce job will create a significant amount of intermediate data that it needs to transfer between mappers and reducers which is a potential bottleneck. A custom implementation of which of the following interfaces is most likely to reduce the amount of intermediate data transferred across the network?
Options
- AWritable
- BWritableComparable
- CInputFormat
- DOutputFormat
- ECombiner
- FPartitioner
How the community answered
(31 responses)- B3% (1)
- C6% (2)
- E81% (25)
- F10% (3)
Community Discussion
No community discussion yet for this question.