Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

后端 未结 5 1757
长情又很酷
长情又很酷 2020-12-31 04:23

I\'m trying to run the spark examples from Eclipse and getting this generic error: Initial job has not accepted any resources; check your cluster UI to en

5条回答
  •  滥情空心
    2020-12-31 04:48

    Solution to your Answer

    Reason

    1. Spark Master doesn't have any resources allocated to execute the Job like worker node or slave node.

    Fix

    1. You have to start the slave node by connecting with the master node like this /SPARK_HOME/sbin> ./start-slave.sh spark://localhost:7077 (if your master in your local node)

    Conclusion

    1. start your master node and also slave node during spark-submit, so that you will get the enough resources allocated to execute the job.

    Alternate-way

    1. You need to make necessary changes in spark-env.sh file which is not recommended.

提交回复
热议问题