If I have an RDD that I no longer need, how do I delete it from memory? Would the following be enough to get this done:
del thisRDD
Thanks!
Just FYI, I would recommend gc.collect() after del (if rdd takes lots of memory).
gc.collect()
del