H13-711_V3.5 · Question #315
In the Huawei Fusioninsight HD cluster, which of the following services can the Spark service read data from? (Multiple choice)
The correct answer is B. HDFS C. Hive D. HBase. Spark can read data from HDFS (B) as its primary distributed storage layer, from Hive (C) via HiveContext/SparkSQL which translates Hive metastore tables into Spark DataFrames, and from HBase (D) using the hbase-spark connector that maps HBase tables into RDDs or DataFrames…
Question
In the Huawei Fusioninsight HD cluster, which of the following services can the Spark service read data from? (Multiple choice)
Options
- AYARN
- BHDFS
- CHive
- DHBase
How the community answered
(28 responses)- A29% (8)
- B71% (20)
Explanation
Spark can read data from HDFS (B) as its primary distributed storage layer, from Hive (C) via HiveContext/SparkSQL which translates Hive metastore tables into Spark DataFrames, and from HBase (D) using the hbase-spark connector that maps HBase tables into RDDs or DataFrames.
YARN (A) is wrong because YARN is a resource manager/scheduler - it allocates CPU and memory for Spark jobs but is not a data source. Spark runs on YARN; it does not read data from YARN.
Memory tip: Think "where is the data stored?" - HDFS stores files, Hive stores structured tables, HBase stores NoSQL key-value data. YARN only manages compute resources, so it has nothing to give Spark to read.
Topics
Community Discussion
No community discussion yet for this question.