Filter Pyspark dataframe column with None value

Question

I\'m trying to filter a PySpark dataframe that has None as a row value:

df.select(\'dt_mvmt\').distinct().collect()

[Row(dt_mvmt=u\'2016-03-27\         


        

Answer 1

If you want to keep with the Pandas syntex this worked for me.

df = df[df.dt_mvmt.isNotNull()]