(run-main-0) java.lang.NoSuchMethodError

Question

I got a problem when I used sbt to run a spark job, I have finish compile, but when I run the command run, I got the problem below

 [er         


        

Answer 1

I've the same issue but where do i alter the scala-library version?

Installation (on Ubuntu 16.04):

sudo apt-get install oracle-java8-installer
wget http://d3kbcqa49mib13.cloudfront.net/spark-2.0.2-bin-hadoop2.7.tgz && tar xvf spark-2.0.2-bin-hadoop2.7.tgz
pip install toree && jupyter toree install

So when I start with a notebook it tells me that I use a different scala version. But I haven't installed anything else. screenshot + scala version

My spark jars folder contains an scala-library-2.11.8.jar file. But how tell torree to use that (or another) file for scala.

Answer 2

It is probably caused by using incompatible versions of Scala. When I downgraded from Scala 2.11 to 2.10, I forgot to modify one package version (so one package used 2.11, the rest 2.10), resulting in having the same error.

Note: I only had this problem when using IntelliJ.

Answer 3

The issue could be reproduced with version 2.11.8.

By the moment, no downgrade is required. Just update scala-library version to 2.12.0.