PySpark error: AttributeError: 'NoneType' object has no attribute '_jvm'

前端 未结 5 1998
既然无缘
既然无缘 2020-12-06 10:33

I have timestamp dataset which is in format of

And I have written a udf in pyspark to process this dataset and return as Map of key values. But am getting below err

5条回答
  •  轻奢々
    轻奢々 (楼主)
    2020-12-06 10:52

    The error message says that in 27th line of udf you are calling some pyspark sql functions. It is line with abs() so I suppose that somewhere above you call from pyspark.sql.functions import * and it overrides python's abs() function.

提交回复
热议问题