spark :12: error: not found: value sc

Question

I wrote the following:

val a = 1 to 10000
val b = sc.parallelize(a)

and it shows error saying:

:12: error: n         


        

Answer 1

First check the log file after spark-shell command run whether SparkContext is initinalized as sc. if SparkContext is not initialized properly

you have to set the IP address in spark environment.

Open the env file in conf/spark.env.sh and add the below line

export SPARK_LOCAL_IP="127.0.0.1"