multiple conditions for filter in spark data frames

前端 未结 11 1162
醉酒成梦
醉酒成梦 2020-12-03 04:41

I have a data frame with four fields. one of the field name is Status and i am trying to use a OR condition in .filter for a dataframe . I tried below queries but no luck.

11条回答
  •  天涯浪人
    2020-12-03 05:06

    For future references : we can use isInCollection to filter ,here is a example : Note : It will look for exact match

      def getSelectedTablesRows(allTablesInfoDF: DataFrame, tableNames: Seq[String]): DataFrame = {
    
        allTablesInfoDF.where(col("table_name").isInCollection(tableNames))
    
      }
    

提交回复
热议问题