Where does a MapReduce job store the intermediate data output from Mappers?

The correct answer is D. On the underlying filesystem of the local disk of the machine on which the Mapper ran. The mapper output (intermediate data) is stored on the Local file system (NOT HDFS) of each individual mapper nodes. This is typically a temporary directory location which can be setup in config by the hadoop administrator. The intermediate data is cleaned up after the Hadoop…

Configuration

Question

Options

AOn the underlying filesystem of the local disk machine on which the JobTracker ran.
BIn HDFS, in the job's output directory.
CIn HDFS, in temporary directory defined mapred.tmp.dir.
DOn the underlying filesystem of the local disk of the machine on which the Mapper ran.
EStores on the underlying filesystem of the local disk of the machine on which the Reducer.

How the community answered

(34 responses)

B
6% (2)
C
3% (1)
D
79% (27)
E
12% (4)

Explanation

The mapper output (intermediate data) is stored on the Local file system (NOT HDFS) of each individual mapper nodes. This is typically a temporary directory location which can be setup in config by the hadoop administrator. The intermediate data is cleaned up after the Hadoop Job Mapper Output (intermediate kay-value data) stored ?

Topics

#intermediate data#local disk#Mapper output#MapReduce

Community Discussion

No community discussion yet for this question.

Full CCA-410 Practice