Apache Spark Exception in thread “main” java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class

Question

Scala version:2.11.7(had to upgrade the scala verison to enable case clasess to accept more than 22 parameters.) Spark version:1.6.1 PFB pom.xml

Getting below error

Answer 1

In the POM you have Scala version 2.11.7 but later on in the dependencies you are declaring Spark deps compiled against 2.10:

spark-streaming_2.10
spark-core_2.10
spark-sql_2.10

You have to change it to:

spark-streaming_2.11
spark-core_2.11
spark-sql_2.11