Spark Standalone Cluster - Slave not connecting to Master

后端 未结 4 1420
孤独总比滥情好
孤独总比滥情好 2020-12-08 07:59

I am trying to setup a Spark standalone cluster following the official documentation.

My master is on a local vm running ubuntu and I also have one worker running in

4条回答
  •  渐次进展
    2020-12-08 08:37

    All solutions above didn't work for me, but I found one more way to fix problem: Stackoverflow: spark worker not connecting to master

    Please check configuration file "spark-env.sh" on your master node. Have you set the SPARK_MASTER_HOST variable to the IP address of the master node? If not try to set it and restart the master and slaves. For example, if your master node's IP is 192.168.0.1, you should have SPARK_MASTER_HOST=192.168.0.1 in there. Note that you don't need to set this variable on your slaves.

提交回复
热议问题