Error while running Mapreduce(yarn)from windows eclipse

后端 未结 1 561
走了就别回头了
走了就别回头了 2020-12-20 10:11

I am running a WordCount program from my eclipse. I tried with Hadoop1.x it is running fine. Facing issue while running on hadoop2.x

i tried 1)added all xml into my

相关标签:
1条回答
  • 2020-12-20 10:44

    I have figured out the issue, there is a jira for it:https://issues.apache.org/jira/browse/MAPREDUCE-5655

    I just added YARNRunner.java & MRApps.java to my project . It also reqires to add the following property to mapred-site.xml on the windows box, so that the job launcher knows, that the job runner will be a linux:

    <property>
    <name>mapred.remote.os</name>
    <value>Linux</value>
    <description>Remote MapReduce framework's OS, can be either Linux or Windows</description>
    </property>
    

    And MapReduce is running fine now.

    Also Copy org.apache.hadoop.util.Shell.java into your project.

    You can comment out the below line,to remove the winutils.exe Error.
    throw new IOException("Could not locate executable " + fullExeName + " in the Hadoop binaries.");

    0 讨论(0)
提交回复
热议问题