SBT assembly jar exclusion

Question

Im using spark (in java API) and require a single jar that can be pushed to the cluster, however the jar itself should not include spark. The app that deploys the jobs of co

Answer 1

For beginners like me, simply add the % Provided to Spark dependencies to exclude them from an uber-jar:

libraryDependencies += "org.apache.spark" %% "spark-core" % "1.4.0" % Provided
libraryDependencies += "org.apache.spark" %% "spark-sql" % "1.4.0" % Provided

in build.sbt.