MapReduce: Log file locations for stdout and std err

孤人 提交于 2019-12-08 05:24:43

问题


If I output some message thru stdout (System.out in Java) and stderr (System.err in Java) in Mapper and Reducer, where can I see them in task tracker node? I guess the directory location is configurable thru some parameter as well?


回答1:


This might depend on which distribution you are using but with our cdh3 setup, we can find them under /usr/lib/hadoop-0.20/logs/userlogs// on the node where the task ran. For example, stderr would be under:

/usr/lib/hadoop-0.20/logs/userlogs/job_201207010432_5284/attempt_201207010432_5284_m_000214_0/stderr

If you have access to the job tracker UI for your cluster, you can also access them through there (which is what I typically do).



来源:https://stackoverflow.com/questions/11596801/mapreduce-log-file-locations-for-stdout-and-std-err

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!