multiple conditions for filter in spark data frames

前端 未结 11 1131
醉酒成梦
醉酒成梦 2020-12-03 04:41

I have a data frame with four fields. one of the field name is Status and i am trying to use a OR condition in .filter for a dataframe . I tried below queries but no luck.

11条回答
  •  轻奢々
    轻奢々 (楼主)
    2020-12-03 05:01

    In spark/scala, it's pretty easy to filter with varargs.

    val d = spark.read...//data contains column named matid
    val ids = Seq("BNBEL0608AH", "BNBEL00608H")
    val filtered = d.filter($"matid".isin(ids:_*))
    

提交回复
热议问题