How to pick up all data into hive from subdirectories

♀尐吖头ヾ 提交于 2019-12-03 12:47:49

Answering my own question with solution that works for my case. SET mapred.input.dir.recursive=true;

ALTER TABLE sampledata
ADD 
PARTITION (ystr ='2012', ymstr='2012-01', ymdstr='2012-01-01') 
LOCATION '/path/to/data/2012/2012-01/2012-01-01';
SET hive.mapred.supports.subdirectories=true;
SET mapred.input.dir.recursive=true;
enjoy

The following worked on hortonworks

alter table .... set blproperties (
    "hive.input.dir.recursive" = "TRUE",
    "hive.mapred.supports.subdirectories" = "TRUE",
    "hive.supports.subdirectories" = "TRUE",
    "mapred.input.dir.recursive" = "TRUE");
标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!