Detected Guava issue #1635 which indicates that a version of Guava less than 16.01 is in use

前端 未结 6 695
野性不改
野性不改 2021-01-18 10:07

I am running spark job on emr and using datastax connector to connect to cassandra cluster. I am facing issues with the guava jar please find the details as below I am using

6条回答
  •  没有蜡笔的小新
    2021-01-18 10:15

    I was able to get around this by adding the guava 16.0.1 jar externally and then specifying the class-path on Spark submit with help of below configuration values:

    --conf "spark.driver.extraClassPath=/guava-16.0.1.jar" --conf "spark.executor.extraClassPath=/guava-16.0.1.jar"

    Hope this helps someone with similar error !

提交回复
热议问题