Cloudera
CCA-500 · Question #1
You need to analyze 60,000,000 images stored in JPEG format, each of which is approximately 25 KB. Because you Hadoop cluster isn't optimized for storing and processing many small files, you decide…
The correct answer is E. SequenceFiles. Sequence files are block-compressed and provide direct serialization and deserialization of several arbitrary data types (not just text). Sequence files can be generated as the output of other MapReduce tasks and are an efficient intermediate representation for data that is…
Configuration
Question
You need to analyze 60,000,000 images stored in JPEG format, each of which is approximately 25 KB. Because you Hadoop cluster isn't optimized for storing and processing many small files, you decide to do the following actions: 1. Group the individual images into a set of larger files 2. Use the set of larger files as input for a MapReduce job that processes them directly with python using Hadoop streaming. Which data serialization system gives the flexibility to do this?
Options
- ACSV
- BXML
- CHTML
- DAvro
- ESequenceFiles
- FJSON
How the community answered
(27 responses)- B7% (2)
- D4% (1)
- E85% (23)
- F4% (1)
Explanation
Sequence files are block-compressed and provide direct serialization and deserialization of several arbitrary data types (not just text). Sequence files can be generated as the output of other MapReduce tasks and are an efficient intermediate representation for data that is passing from one MapReduce job to anther.
Topics
#SequenceFiles#small files problem#data serialization#MapReduce streaming
Community Discussion
No community discussion yet for this question.