Hadoop IOException failure to login

后端 未结 3 1258
青春惊慌失措
青春惊慌失措 2021-02-13 05:32

I\'m pretty new to Hadoop. However, I\'ve been able to successfully setup hadoop 2.7.3 with Java 7 in the cluster mode on my servers. Everything works totally fine.

But

3条回答
  •  走了就别回头了
    2021-02-13 05:56

    Faced same error while running spark code from IDE.

    Exception in thread "main" java.io.IOException: failure to login
            at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:822)
            at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:774)
            at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:647)
            at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
            at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
            at scala.Option.getOrElse(Option.scala:121)
            at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2464)
            at org.apache.spark.SparkContext.(SparkContext.scala:292)
            at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2486)
            at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:930)
            at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:921)
            at scala.Option.getOrElse(Option.scala:121)
            at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:921)
            at SimpleApp$.main(SimpleApp.scala:17)
            at SimpleApp.main(SimpleApp.scala)
    Caused by: javax.security.auth.login.LoginException:
    java.lang.NullPointerException: invalid null input: name
    

    Resolution added following statement in main code.

    UserGroupInformation.setLoginUser(UserGroupInformation.createRemoteUser("vyxx"))
    

提交回复
热议问题