Ubuntu install apache spark via apt-get

后端 未结 1 1351
轮回少年
轮回少年 2021-01-05 15:41

I need to install spark and run it in standalone mode on one machine and looking for a straight forward way to install it via apt-get

I found how to do this with py

相关标签:
1条回答
  • 2021-01-05 16:25

    Before installing pyspark you must install Java8. This is described at

    • http://www.webupd8.org/2014/03/how-to-install-oracle-java-8-in-debian.html
    • http://www.webupd8.org/2012/09/install-oracle-java-8-in-ubuntu-via-ppa.html

    For a fully automatic installation of Java8 on Ubuntu do

    $ apt-get update
    $ apt-get -y install software-properties-common
    $ add-apt-repository -y ppa:webupd8team/java
    $ echo debconf shared/accepted-oracle-license-v1-1 select true | debconf-set-selections
    $ echo debconf shared/accepted-oracle-license-v1-1 seen true | debconf-set-selections
    $ apt-get update
    $ apt-get -y install oracle-java8-installer
    

    (see https://newfivefour.com/docker-java8-auto-install.html)

    Afterwards you can simply run pip install pyspark.

    0 讨论(0)
提交回复
热议问题