DatabricksDatabricks
DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK · Question #27
DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Question #27: Real Exam Question with Answer & Explanation
The correct answer is D: storesDF.coalesce(1). See the full explanation below for the reasoning.
Spark DataFrame Transformations and Performance
Question
Which of the following operations can be used to return a new DataFrame from DataFrame storesDF without inducing a shuffle?
Options
- AstoresDF.intersect()
- BstoresDF.repartition(1)
- CstoresDF.union()
- DstoresDF.coalesce(1)
- EstoresDF.rdd.getNumPartitions()
Topics
#Spark DataFrame API#Shuffle#Partitioning#Performance Optimization
Community Discussion
No community discussion yet for this question.