Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

后端 未结 4 1998
情话喂你
情话喂你 2020-12-03 08:37

I have some web server logs that I\'d like to query with Hive. The directory structure, in HDFS, looks like this:

/data/access/web1/2014/09
/data/access/web1         


        
4条回答
  •  無奈伤痛
    2020-12-03 09:23

    These are not tables properties.

    TBLPROPERTIES ("hive.input.dir.recursive" = "TRUE", 
        "hive.mapred.supports.subdirectories" = "TRUE",
        "hive.supports.subdirectories" = "TRUE", 
        "mapred.input.dir.recursive" = "TRUE");
    

    A) add

      
        mapred.input.dir.recursive
        true
      
    
      
        hive.mapred.supports.subdirectories
        true
      
    

    in hive-site.xml

提交回复
热议问题