I have a data frame with four fields. one of the field name is Status and i am trying to use a OR condition in .filter for a dataframe . I tried below queries but no luck.>
Another way is to use function expr with where clause
import org.apache.spark.sql.functions.expr df2 = df1.where(expr("col1 = 'value1' and col2 = 'value2'"))
It works the same.