hiveql

I have two tables one is schools and one is students.I want to find all the students of a particular school. The schema of schools is: id, name, location and of students is :id, name, schoolId. I wrote the following script: schoolId=$(hive -e "set hive.cli.print.header=false;select id from school;") hive -hiveconf "schoolId"="$schoolId" hive>select id,name from student where schoolId like '${hiveconf:schoolId}%' I dont get any result as schoolId stores all the id together.For example there are 3 schools with id: 123, 256,346 schoolId variable stores as 123 256 346 and the result is null. Use

I want to get the current date as YYMMDD and then set it to variable in order to use it as table name. Here is my code: set dates= date +%Y-%m-%d; CREATE EXTERNAL TABLE IF NOT EXISTS dates( id STRING, region STRING, city STRING) But this method doesn't work, because it seems the assignments are wrong. Any idea? Hive does not calculate variables, it substitutes them as is, in your case it will be exactly this string ' date +%Y-%m-%d '. Also it is not possible to use UDF like current_date() in place of table name in DDL. The solution is to calculate variable in the shell and pass it to Hive: In

I'm having data of day='2019-01-01' in my hive table, I want to copy same data to whole Jan-2019 month. (i.e. in '2019-01-02' , '2019-01-03' ... '2019-01-31' ) I'm trying following but data is only inserted in '2019-01-02' and not in '2019-01-03'. INSERT OVERWRITE TABLE db_t.students PARTITION(dt='2019-01-02', dt='2019-01-03') SELECT id, name, marks FROM db_t.students WHERE dt='2019-01-01'; Cross join all your data with calendar dates for required date range. Use dynamic partitioning: set hivevar:start_date=2019-01-02; set hivevar:end_date=2019-01-31; set hive.exec.dynamic.partition=true; set

I am trying to translate some PL/SQL script in hive, and i faced an error with one HiveQL script. The error is this one : FAILED: SemanticException Failed to breakup Windowing invocations into Groups. At least 1 group must only depend on input columns. Also check for circular dependencies. Underlying error: org.apache.hadoop.hive.ql.exec.UDFArgumentTypeException: One or more arguments are expected. I think that the error is coming from this part of script : SELECT mag.co_magasin, dem.id_produit as id_produit_orig, pnvente.dt_debut_commercial as dt_debut_commercial, COALESCE(pnvente.id_produit

I have a hive table which has String column having value as 12,345. Is there any way hive function which can remove comma during insertion in this hive table ? You can use regexp_replace(string INITIAL_STRING, string PATTERN, string REPLACEMENT) which is a function in Hive. So if you are moving the data from a table that contains the comma to a new table you will use : insert into table NEW select regexp_replace(commaColumn,',','') from OLD; Harikrishnan Ck Hive does have split function. which can be used here. split and concat to achieve the desired result You may refer this question. Does