spark :12: error: not found: value sc

Question

I wrote the following:

val a = 1 to 10000
val b = sc.parallelize(a)

and it shows error saying:

:12: error: n         


        

Answer 1

You get this error, because sc is not defined. I would try:

sc = SparkContext(appName = "foo")

---

Another thing that usually happens to me is not getting a Kerberos ticket in the cluster, because I forgot too.

---

As for the "open issue in Spark" mentioned by Solnanki, I am pretty sure this is not the case any more.