Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

Question

I have some web server logs that I\'d like to query with Hive. The directory structure, in HDFS, looks like this:

/data/access/web1/2014/09
/data/access/web1         


        

Answer 1

If you are using ambari the set the following properties to hive advanced config inside custom hive-site.xml.

**- SET hive.input.dir.recursive=TRUE

SET hive.mapred.supports.subdirectories=TRUE

SET hive.supports.subdirectories=TRUE

SET mapred.input.dir.recursive=TRUE**

And then restart the affected services. This will read all the data recursively.