Hadoop Map-reduce job failed

谁都会走 提交于 2019-12-11 17:51:57

问题


I am currently using a hadoop 5 node cluster with 5 slaves Each datanode has a capacity of 8.7 TB. I am executing a map reduce job to execute 312 GB of data but got a error of Apllication failed after executing the program. I cant understand the error, firstly the map reduce job started , it got to 11% after that it started again from 1%.

1) Am i executing a bigger dataset that cant be executed in the cluster configuration ?

2) Do i need to configure out my map reduce drivers for running the job on the dataset, what would be possible configurations ? Please refer the screenshot for details.

来源:https://stackoverflow.com/questions/48260146/hadoop-map-reduce-job-failed

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!