hiveql

问题 When performing: hive -e 'select * from database.table' > /localfilesystem/mytable.txt the column header names are in the form database.columnname and I would like them to be columnname only. Is there a way to supress the database in the columnname when performing the above type of query? 回答1: hive.resultset.use.unique.column.names was added in 0.13 and defaults to True . Just set it to false in your ~/.hiverc or in hive-site.xml <property> <name>hive.resultset.use.unique.column.names</name>

问题 I'm trying to create a partitioned table using dynamic partitioning, but i'm facing an issue. I'm running Hive 0.12 on Hortonworks Sandbox 2.0. set hive.exec.dynamic.partition=true; INSERT OVERWRITE TABLE demo_tab PARTITION (land) SELECT stadt, geograph_breite, id, t.country FROM demo_stg t; however it does not work.. I'm getting an Error. Here is the Query to create the table demo_stg : create table demo_stg ( country STRING, stadt STRING, geograph_breite FLOAT, id INT ) ROW FORMAT DELIMITED

问题 I'm trying to create a partitioned table using dynamic partitioning, but i'm facing an issue. I'm running Hive 0.12 on Hortonworks Sandbox 2.0. set hive.exec.dynamic.partition=true; INSERT OVERWRITE TABLE demo_tab PARTITION (land) SELECT stadt, geograph_breite, id, t.country FROM demo_stg t; however it does not work.. I'm getting an Error. Here is the Query to create the table demo_stg : create table demo_stg ( country STRING, stadt STRING, geograph_breite FLOAT, id INT ) ROW FORMAT DELIMITED

问题 I'm trying to create a partitioned table using dynamic partitioning, but i'm facing an issue. I'm running Hive 0.12 on Hortonworks Sandbox 2.0. set hive.exec.dynamic.partition=true; INSERT OVERWRITE TABLE demo_tab PARTITION (land) SELECT stadt, geograph_breite, id, t.country FROM demo_stg t; however it does not work.. I'm getting an Error. Here is the Query to create the table demo_stg : create table demo_stg ( country STRING, stadt STRING, geograph_breite FLOAT, id INT ) ROW FORMAT DELIMITED

问题 I am developing a batch job that loads data into Hive tables from HDFS files. The flow of data is as follows Read the file received in HDFS using an external Hive table INSERT OVERWRITE the final hive table from the external Hive table applying certain transformations Move the received file to Archive This flow works fine if there is a file in the input directory for the external table to read during step 1. If there is no file, the external table will be empty and as a result executing step

问题 I am developing a batch job that loads data into Hive tables from HDFS files. The flow of data is as follows Read the file received in HDFS using an external Hive table INSERT OVERWRITE the final hive table from the external Hive table applying certain transformations Move the received file to Archive This flow works fine if there is a file in the input directory for the external table to read during step 1. If there is no file, the external table will be empty and as a result executing step

问题 I am developing a batch job that loads data into Hive tables from HDFS files. The flow of data is as follows Read the file received in HDFS using an external Hive table INSERT OVERWRITE the final hive table from the external Hive table applying certain transformations Move the received file to Archive This flow works fine if there is a file in the input directory for the external table to read during step 1. If there is no file, the external table will be empty and as a result executing step

问题 Problem Statement:- I need to compare two tables Table1 and Table2 and they both store same thing. So I need to compare Table2 with Table1 as Table1 is the main table through which comparisons need to be made. So after comparing I need to make a report that Table2 has some sort of discrepancy. And these two tables has lots of data, around TB of data. So currently I have written HiveQL to do the comparisons and get the data back. So my question is which is better in terms of PERFORMANCE ,

问题 Problem Statement:- I need to compare two tables Table1 and Table2 and they both store same thing. So I need to compare Table2 with Table1 as Table1 is the main table through which comparisons need to be made. So after comparing I need to make a report that Table2 has some sort of discrepancy. And these two tables has lots of data, around TB of data. So currently I have written HiveQL to do the comparisons and get the data back. So my question is which is better in terms of PERFORMANCE ,

问题 Problem Statement:- I need to compare two tables Table1 and Table2 and they both store same thing. So I need to compare Table2 with Table1 as Table1 is the main table through which comparisons need to be made. So after comparing I need to make a report that Table2 has some sort of discrepancy. And these two tables has lots of data, around TB of data. So currently I have written HiveQL to do the comparisons and get the data back. So my question is which is better in terms of PERFORMANCE ,