问题
We have secure hadoop server and We are running spark streaming job to consume from secure kafka topic. For authentication, I am passing hadoop keytab and its principal to spark-submit command along Kafka keytab but the job is failing .
If we remove --keytab and --principal from the command and try authenticating hadoop keytab using KINIT before running spark command - its working perfectly fine.
spark2-submit --keytab Hadoop.keytab -- principal abc@adlov.org --file kafka.keytab
My requirement is to autheticate the hadoop keytab while running the spark job i.e by passing hadoop keytab to spark job along with Kafka keytabs. Any idea, how we can achieve it.
来源：https://stackoverflow.com/questions/57409926/how-to-use-hadoop-and-kafka-keytab-in-same-spark-submit-command