setup and cleanup methods of Mapper/Reducer in Hadoop MapReduce

前端 未结 5 1792
一生所求
一生所求 2020-12-24 03:10

Are setup and cleanup methods called in each mapper and reducer tasks respectively? Or are they called only once at the start of overall mapper and reducer jobs?

5条回答
  •  醉话见心
    2020-12-24 03:27

    on the reducer you can on the job do job.setNumReduceTasks(1); and that way the setup and clean-up of the reducer only will be run once.

提交回复
热议问题