security.UserGroupInformation: PriviledgedActionException error for MR

懵懂的女人 提交于 2019-12-07 13:24:09

问题


Whenever i m trying to execute a map reduce job to write to Hbase table i am getting the following error in the console. I am running the MR job from the user account.

ERROR security.UserGroupInformation: PriviledgedActionException as:user cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/data1/input/Filename.csv

I did the hadoop ls, user is the owner of the file.

-rw-r--r-- 1 user supergroup 7998682 2014-04-17 18:49 /data1/input/Filename.csv

All my daemons are perfectly running, if i am using hbase client api, i am able to insert.

Please help, thanks in advance.

Thanks, KG


回答1:


If you look at the following path

Input path does not exist: file:/data1/input/Filename.csv

you can see that it is pointing to local filesystem not to hdfs. Try prefixing the filesystem type hdfs in the path as follows

hdfs://<NAMENODE-HOST>:<IPC-PORT>/data1/input/Filename.csv


来源:https://stackoverflow.com/questions/23135541/security-usergroupinformation-priviledgedactionexception-error-for-mr

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!