hadoop only launch local job by default why?

后端 未结 3 2060
孤街浪徒
孤街浪徒 2021-01-05 12:44

I have written my own hadoop program and I can run using pseudo distribute mode in my own laptop, however, when I put the program in the cluster which can run example jar of

3条回答
  •  梦毁少年i
    2021-01-05 13:36

    I had the same problem that every mapreduce v2 (mrv2) or yarn task only ran with the mapred.LocalJobRunner

    INFO mapred.LocalJobRunner: Starting task: attempt_local284299729_0001_m_000000_0
    

    The Resourcemanager and Nodemanagers were accessible and the mapreduce.framework.name was set to yarn.

    Setting the HADOOP_MAPRED_HOME before executing the job fixed the problem for me.

    export HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce
    

    cheers dan

提交回复
热议问题