Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

后端 未结 4 2043
情话喂你
情话喂你 2020-12-03 08:37

I have some web server logs that I\'d like to query with Hive. The directory structure, in HDFS, looks like this:

/data/access/web1/2014/09
/data/access/web1         


        
4条回答
  •  孤街浪徒
    2020-12-03 09:29

    Using Hive in HDInsight, I set the following properties before I create my external table in the Hive query and it works for me.

    SET hive.mapred.supports.subdirectories=TRUE;
    SET mapred.input.dir.recursive=TRUE;
    

提交回复
热议问题