NoClassDefFoundError com.apache.hadoop.fs.FSDataInputStream when execute spark-shell

Question

I\'ve downloaded the prebuild version of spark 1.4.0 without hadoop (with user-provided Haddop). When I ran the spark-shell command, I got this error:

> E         


        

Answer 1

Run below from your package dir just before running spark-submit -

export SPARK_DIST_CLASSPATH=`hadoop classpath`