I have two versions of Python. When I launch a spark application using spark-submit, the application uses the default version of Python. But, I want to use the other one. How to
In my environment I simply used
export PYSPARK_PYTHON=python2.7
It worked for me