Why we are configuring mapred.job.tracker in YARN?

折月煮酒 提交于 2020-02-24 05:24:30

问题


What I know is YARN is introduced and it replaced JobTracker and TaskTracker.

I have seen is some Hadoop 2.6.0/2.7.0 installation tutorials and they are configuring mapreduce.framework.name as yarn and mapred.job.tracker property as local or host:port.

The description for mapred.job.tracker property is

"The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task."

My doubt is why are configuring it if we are using YARN , I mean JobTracker shouldn't be running right?

Forgive me if my question is dumb.

Edit: These are the tutorials I was talking about.

http://chaalpritam.blogspot.in/2015/01/hadoop-260-multi-node-cluster-setup-on.html

http://pingax.com/install-apache-hadoop-ubuntu-cluster-setup/

https://chawlasumit.wordpress.com/2015/03/09/install-a-multi-node-hadoop-cluster-on-ubuntu-14-04/


回答1:


This is just a guess, but either those tutorials talking about configuring the JobTracker in YARN are written by people who don't know what YARN is, or they set it in case you decide to stop working with YARN someday. You are right: the JobTracker and TaskTracker do not exist in YARN. You can add the properties if you want, but they will be ignored. New properties for each of the components replacing the JobTracker and the TaskTracker were added with YARN, such as yarn.resourcemanager.address to replace mapred.jobtracker.address.

If you list your Java processes when running Hadoop under YARN, you see no JobTrackeror TaskTracker:

10561 Jps
20605 NameNode
17176 DataNode
18521 ResourceManager
19625 NodeManager
18424 JobHistoryServer

You can read more about how YARN works here.



来源:https://stackoverflow.com/questions/30863615/why-we-are-configuring-mapred-job-tracker-in-yarn

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!