Spark配置
解压和重命名文件 tar -zxvf spark-2.2.0-bin-hadoop2.7.tgz mkdir /opt/spark mv spark-2.2.0-bin-hadoop2.7 /opt/spark/spark2.2 进入配置文件目录 cd /opt/spark/spark2.2/conf/ cp spark-env.sh.template spark-env.sh 编辑 spark-env.sh 在第二行空白处添加信息 vim spark-env.sh export SPARK_DIST_CLASSPATH=$(/opt/hadoop/hadoop2.7/bin/hadoop classpath) 配置环境变量 vim /etc/profile # Spark Config export SPARK_HOME=/opt/spark/spark2.2 export PATH=.:${JAVA_HOME}/bin:${SCALA_HOME}/bin:${SPARK_HOME}/bin:${HADOOP_HOME}/bin:${HADOOP_HOME}/sbin:${ZK_HOME}/bin:${HBASE_HOME}/bin:${HIVE_HOME}/bin:${KAFKA_HOME}/bin:${SQOOP_HOME}/bin:${FLUME_HOME}/bin:$