differentiate driver code and work code in Apache Spark

前端 未结 2 1700
迷失自我
迷失自我 2021-01-05 05:11

In Apache Spark program how do we know which part of code will execute in driver program and which part of code will execute in worker nodes?

With Regards

2条回答
  •  猫巷女王i
    2021-01-05 05:45

    All the closures passed as argument to method of JavaRDD/JavaPairRDD/similar and some method of these classes will be executed by spark nodes. Everything else is driver code.

提交回复
热议问题