java.io.IOException: Cannot run program “python” using Spark in Pycharm (Windows)

Question

I am trying to write a very simple code using Spark in Pycharm and my os is Windows 8. I have been dealing with several problems which somehow managed to fix except for one.

Answer 1

I have faced this problem, it's caused by python version conflicts on diff nodes of cluster, so, it can be solved by

export PYSPARK_PYTHON=/usr/bin/python

which are the same version on diff nodes. and then start:

pyspark