Why caching small Spark RDDs takes big memory allocation in Yarn?

前端 未结 0 1545
天命终不由人
天命终不由人 2020-12-23 00:06

The RDDs that are cached (in total 8) are not big, only around 30G, however, on Hadoop UI, it shows that the Spark application is taking lots of memory (no

相关标签:
回答
  • 消灭零回复
提交回复
热议问题