【Hadoop】YARN 完全分布式配置

谁说胖子不能爱 提交于 2020-04-03 12:37:10

承接 https://www.cnblogs.com/jzsg/p/12622214.html

mv mapred-site.xml.template  mapred-site.xml

// 基于YARN的资源调度配置
vi etc/hadoop/mapred-site.xml:


<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
</configuration>



vi etc/hadoop/yarn-site.xml:


<configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>

    <property>
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>172.16.152.130:8031</value>
    </property>
    <property>
            <name>yarn.resourcemanager.address</name>
            <value>172.16.152.130:8033</value>
    </property>
    <property>
            <name>yarn.resourcemanager.scheduler.address</name>
            <value>172.16.152.130:8034</value>
    </property>
    <property>
            <name>yarn.resourcemanager.webapp.address</name>
            <value>172.16.152.130:8088</value>
    </property>

    <property>
            <name>yarn.nodemanager.local-dirs</name>
            <value>/opt/hadoop_tmp/yarn/local</value>
    </property>
    <property>
            <name>yarn.log-aggregation-enable</name>
            <value>true</value>
    </property>
    <property>
          <name>yarn.log.server.url</name>
          <value>http://master:19888/jobhistory/logs/</value>
    </property>
</configuration>    


修改后拷贝至从节点(slave)
scp -r yarn-site.xml root@slave:/usr/local/software/hadoop-2.5.1/etc/hadoop/


$ sbin/start-yarn.sh

$ sbin/stop-yarn.sh


在master上jsp 发现 20906 ResourceManager,从节点发现20808 NodeManager 即成功,

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!