When do reduce tasks start in Hadoop?

前端 未结 8 838
深忆病人
深忆病人 2020-11-27 10:04

In Hadoop when do reduce tasks start? Do they start after a certain percentage (threshold) of mappers complete? If so, is this threshold fixed? What kind of threshold is typ

8条回答
  •  春和景丽
    2020-11-27 10:34

    Reduce starts only after all the mapper have fished there task, Reducer have to communicate with all the mappers so it has to wait till the last mapper finished its task.however mapper starts transferring data to the moment it has completed its task.

提交回复
热议问题