I\'m new to Spark and I\'m busy setting up a Spark Cluster with HA enabled.
When starting a spark shell for testing via: bash spark-shell --master yarn --deploy
bash spark-shell --master yarn --deploy
You must have set your configuration to master("local[*]") from spark session.I have removed and it worked.