How to check the Spark version

后端 未结 15 1276
时光取名叫无心
时光取名叫无心 2020-12-29 17:29

as titled, how do I know which version of spark has been installed in the CentOS?

The current system has installed cdh5.1.0.

15条回答
  •  暖寄归人
    2020-12-29 18:14

    In order to print the Spark's version on the shell, following solution work.

    SPARK_VERSION=$(spark-shell --version &> tmp.data ; grep version tmp.data | head -1 | awk '{print $NF}';rm tmp.data)
    echo $SPARK_VERSION
    

提交回复
热议问题