remove surrounding quotes from fields while loading data into hive

Question

I want to load a table with input data into hive. I have data in the following format.

\"153662\";\"0002241447\";\"0\"
\"153662\";\"000647036X\";\"0\"
\"153         


        

Answer 1

Multiple ways to achieve this:

1. Use CSV serde
2. Use regex serde- regex "\"(.*)\"\;\"(.*)\"\;\"(.*)\""
3. Load data to external table then remove double quotes:

CREATE EXTERNAL TABLE source( a string, b String, c String) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\;' LOCATION 'xyz';

CREATE TABLE destination AS SELECT REGEXP_REPLACE(a,'"',''), REGEXP_REPLACE(b,'"',''), CAST ( REGEXP_REPLACE(c,'"','') AS BIGINT) FROM source;