Pyspark: display a spark data frame in a table format

Question

I am using pyspark to read a parquet file like below:

my_df = sqlContext.read.parquet(\'hdfs://myPath/myDB.db/myTable/**\')

Then when I do

Answer 1

Yes: call the toPandas method on your dataframe and you'll get an actual pandas dataframe !