Spark submit to yarn as a another user

Question

Is it possible to submit a spark job to a yarn cluster and choose, either with the command line or inside the jar, which user will \"own\" the job?

The spark-submit

Answer 1

If your user exists, you can still launch your spark submit with su $my_user -c spark submit [...]

I am not sure about the kerberos keytab, but if you make a kinit with this user it should be fine.

If you can't use su because you don't want the password, I invite you to see this stackoverflow answer: how to run script as another user without password