Can I have multiple spark versions installed in CDH?

一曲冷凌霜 提交于 2019-12-01 08:48:26

Yes, you can run any Apache Spark version you like. Just make sure it's built for the version of YARN you have (2.3 for CDH 5.1.0). You can then run your application as a YARN application with spark-submit. (See http://spark.apache.org/docs/latest/running-on-yarn.html.) It will be monitored like any other YARN application.

Spark doesn't need to be "installed" at all, you just run your application.

PRAFULLA KUMAR DASH

Please execute below commands from your console, with sudo access and password....it will update your spark current version to latest version

sudo yum install spark-core spark-master spark-worker spark-history-server spark-python
sudo yum install spark-core spark-history-server spark-python
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!