where does combiners combine mapper outputs - in map phase or reduce phase in a Map-reduce job?

前端 未结 2 758
刺人心
刺人心 2021-01-13 04:42

I was under the impression that combiners are just like reducers that act on the local map task, That is it aggregates the results of individual Map task in order to reduce

2条回答
  •  半阙折子戏
    2021-01-13 05:23

    1. A combiner will not run if it is a Map-Only job.

    2. A combiner only runs if there are more than 3 spill files written to the disk.

提交回复
热议问题