Optimizing GC on EMR cluster

前端 未结 1 1394
悲&欢浪女
悲&欢浪女 2021-01-04 06:02

I am running a Spark Job written in Scala on EMR and the stdout of each executor is filled with GC allocation failures.

2016-12-07T23:42:20.614+0000: [GC (A         


        
相关标签:
1条回答
  • 2021-01-04 06:30

    Allocation Failure is the normal and the most common reason for initiating GC cycle.

    Logs tell that GC happens once a second and takes about 10ms, that is, 1% time. IMO, there is nothing to optimize here.

    0 讨论(0)
提交回复
热议问题