Missing hive-site when using spark-submit YARN cluster mode

后端 未结 4 707
我在风中等你
我在风中等你 2020-12-06 18:38

Using HDP 2.5.3 and I\'ve been trying to debug some YARN container classpath issues.

Since HDP includes both Spark 1.6 and 2.0.0, there have been some conflicting v

4条回答
  •  囚心锁ツ
    2020-12-06 19:24

    In the cluster mode configuration is read from the conf directory of the machine, which runs the driver container, not the one use for spark-submit.

提交回复
热议问题