hiveql

I store the following JSON objects in a Hive table: { "main_id": "qwert", "features": [ { "scope": "scope1", "name": "foo", "value": "ab12345", "age": 50, "somelist": ["abcde","fghij"] }, { "scope": "scope2", "name": "bar", "value": "cd67890" }, { "scope": "scope3", "name": "baz", "value": [ "A", "B", "C" ] } ] } "features" is an array of varying length, i.e. all objects are optional. The objects have arbitrary elements, but all of them contain "scope", "name" and "value". This is the Hive table I created: CREATE TABLE tbl( main_id STRING,features array<struct<scope:STRING,name:STRING,value

I have a table like the following : User:String Alias:String JohnDoe John JohnDoe JDoe Roger Roger And I would like to group all the aliases of an user in an array, in a new table which would look like this : User:String Alias:array<String> JohnDoe [John, JDoe] Roger [Roger] I can't figure out how to do that with HiveQL.Do I have to write an UDF for that ? Thanks ! Check out the built-in aggregate function collect_set . select User, collect_set(Alias) as Alias from table group by User; 来源： https://stackoverflow.com/questions/16836702/grouping-hive-rows-in-an-array-of-this-rows

I'm a novice. I have a employee table with a column specifying the joining date and I want to retrieve the list of employees who have joined in the last 3 months. I understand we can get the current date using from_unixtime(unix_timestamp()). How do I calculate the datediff? Is there a built in DATEDIFF() function like in MS SQL? please advice! Kishore datediff(to_date(String timestamp), to_date(String timestamp)) For example: SELECT datediff(to_date('2019-08-03'), to_date('2019-08-01')) <= 2; If you need the difference in seconds (i.e.: you're comparing dates with timestamps, and not whole

I have default db in hive table which contains 80 tables . I have created one more database and I want to copy all the tables from default DB to new Databases. Is there any way I can copy from One DB to Other DB, without creating individual table. Please let me know if any solution.. Thanks in advance Venkat Ankam I can think of couple of options. Use CTAS. CREATE TABLE NEWDB.NEW_TABLE1 AS select * from OLDDB.OLD_TABLE1; CREATE TABLE NEWDB.NEW_TABLE2 AS select * from OLDDB.OLD_TABLE2; ... Use IMPORT feature of Hive https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport

I'm writing a code in HIVE to create a table consisting of 1300 rows and 6 columns: create table test1 as SELECT cd_screen_function, SUM(access_count) AS max_count, MIN(response_time_min) as response_time_min, AVG(response_time_avg) as response_time_avg, MAX(response_time_max) as response_time_max, SUM(response_time_tot) as response_time_tot, COUNT(*) as row_count FROM sheet WHERE ts_update BETWEEN unix_timestamp('2012-11-01 00:00:00') AND unix_timestamp('2012-11-30 00:00:00') and cd_office = '016' GROUP BY cd_screen_function ORDER BY max_count DESC, cd_screen_function; Now I want to add