Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

后端 未结 5 1756
长情又很酷
长情又很酷 2020-12-31 04:23

I\'m trying to run the spark examples from Eclipse and getting this generic error: Initial job has not accepted any resources; check your cluster UI to en

5条回答
  •  佛祖请我去吃肉
    2020-12-31 04:53

    I had the same problem, and it was because the workers could not communicate with the driver.

    You need to set spark.driver.port (and open said port on your driver), spark.driver.host and spark.driver.bindAddress in your spark-submit from the driver.

提交回复
热议问题