Apache Spark: Differences between client and cluster deploy modes

Question

TL;DR: In a Spark Standalone cluster, what are the differences between client and cluster deploy modes? How do I set which mode my application is going to r

Answer 1

Let's say you are going to perform a spark submit in EMR by doing SSH to the master node. If you are providing the option --deploy-mode cluster, then following things will happen.

1. You won't be able to see the detailed logs in the terminal.
2. Since driver is not created in the Master itself, you won't be able to terminate the job from the terminal.

But in case of --deploy-mode client:

1. You will be able to see the detailed logs in the terminal.
2. You will be able to terminate the job from the terminal itself.

These are the basic things that I have noticed till now.