How to load IPython shell with PySpark

Question

I want to load IPython shell (not IPython notebook) in which I can use PySpark through command line. Is that possible? I have installed Spark-1.4.1.

Answer 1

According to the official Github, IPYTHON=1 is not available in Spark 2.0+ Please use PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON instead.

https://github.com/apache/spark/blob/master/bin/pyspark