Apache Spark Interview Questions and Answers
Question: What is the Broadcast variable in Spark and when is it used?Answer: A Broadcast variable is a read-only variable cached on each worker node. It is used to efficiently distribute large read-only data structures, such as lookup tables, to all tasks in a Spark job.Example:
|
Is it helpful?
Yes
No
Most helpful rated by users:
- What is the purpose of the Spark SQL module?
- Explain the difference between narrow and wide transformations in Spark.