Spark submit to yarn as a another user

前端 未结 4 2003
一向
一向 2020-12-16 02:10

Is it possible to submit a spark job to a yarn cluster and choose, either with the command line or inside the jar, which user will \"own\" the job?

The spark-submit

4条回答
  •  别那么骄傲
    2020-12-16 02:42

    For a non-kerberized cluster you can add a Spark conf as:

    --conf spark.yarn.appMasterEnv.HADOOP_USER_NAME=
    

提交回复
热议问题