How to delete an RDD in PySpark for the purpose of releasing resources?

前端 未结 4 907
别跟我提以往
别跟我提以往 2020-12-31 00:36

If I have an RDD that I no longer need, how do I delete it from memory? Would the following be enough to get this done:

del thisRDD

Thanks!

4条回答
  •  清歌不尽
    2020-12-31 01:24

    Just FYI, I would recommend gc.collect() after del (if rdd takes lots of memory).

提交回复
热议问题