How to add third party java jars for use in pyspark

Question

I have some third party Database client libraries in Java. I want to access them through

java_gateway.py

E.g: to make the client class (not

Answer 1

You could add --jars xxx.jar when using spark-submit

./bin/spark-submit --jars xxx.jar your_spark_script.py

or set the enviroment variable SPARK_CLASSPATH

SPARK_CLASSPATH='/path/xxx.jar:/path/xx2.jar' your_spark_script.py

your_spark_script.py was written by pyspark API