issue Running Spark Job on Yarn Cluster

Question

I want to run my spark Job in Hadoop YARN cluster mode, and I am using the following command:

spark-submit --master yarn-cluster 
             --dri         


        

Answer 1

The command looks correct.

What I've come across is that the "exit code 15" normally indicates a TableNotFound Exception. That usually means there's an error in the code you're submitting.

You can check this by visiting the tracking URL.