NoClassDefFoundError com.apache.hadoop.fs.FSDataInputStream when execute spark-shell

Question

I\'ve downloaded the prebuild version of spark 1.4.0 without hadoop (with user-provided Haddop). When I ran the spark-shell command, I got this error:

> E         


        

Answer 1

Enter into SPARK_HOME -> conf

copy spark-env.sh.template file and rename it to spark-env.sh Inside this file you can set the parameters for spark.

Answer 2

I too had the issue,

export SPARK_DIST_CLASSPATH=`hadoop classpath`

resolved the issue.