Filter Pyspark dataframe column with None value

Question

I\'m trying to filter a PySpark dataframe that has None as a row value:

df.select(\'dt_mvmt\').distinct().collect()

[Row(dt_mvmt=u\'2016-03-27\         


        

Answer 1

Try to just use isNotNull function.

df.filter(df.dt_mvmt.isNotNull()).count()