Using Scala 2.12 with Spark 2.x

后端 未结 3 1001
一整个雨季
一整个雨季 2020-12-05 18:02

At the Spark 2.1 docs it\'s mentioned that

Spark runs on Java 7+, Python 2.6+/3.4+ and R 3.1+. For the Scala API, Spark 2.1.0 uses Scala 2.11. You wi

3条回答
  •  南方客
    南方客 (楼主)
    2020-12-05 18:46

    Spark does not support Scala 2.12. You can follow SPARK-14220 (Build and test Spark against Scala 2.12) to get up to date status.

    update: Spark 2.4 added an experimental Scala 2.12 support.

提交回复
热议问题