Hive tez execution error

后端 未结 3 2089
无人共我
无人共我 2021-01-07 08:29

I am running a hive query and I got the following error when setting the hive.execution.engine=tez, while the query is working under engine=MR.

FAILED: Exec         


        
3条回答
  •  遥遥无期
    2021-01-07 08:36

    While running your HQL via hive include following parameter. This will give you detailed logs and you can determine the root cause easily.

    -hiveconf hive.root.logger=DEBUG,console
    

    I faced similar problem and above property help me big time.

    e.g.: I got following message

    16/04/14 10:29:26 ERROR exec.Task: Failed to execute tez graph.
    org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=20480, maxMemory=11288
    

    When I changed my setting to 11288, my query went through fine.

    Hope this will help you.

提交回复
热议问题