I am trying to write a very simple code using Spark in Pycharm and my os is Windows 8. I have been dealing with several problems which somehow managed to fix except for one.
I had to set SPARK_PYTHONPATH as environment variable to point to python.exe file in addition to PYTHONPATH and SPARK_HOME variables as
SPARK_PYTHONPATH
PYTHONPATH
SPARK_HOME
SPARK_PYTHONPATH=C:\Python27\python.exe