Hive load CSV with commas in quoted fields

前端 未结 6 910
长情又很酷
长情又很酷 2020-12-23 02:44

I am trying to load a CSV file into a Hive table like so:

CREATE TABLE mytable
(
num1 INT,
text1 STRING,
num2 INT,
text2 STRING
)
ROW FORMAT DELIMITED FIELDS         


        
6条回答
  •  借酒劲吻你
    2020-12-23 03:10

    ORG.APACHE.HADOOP.HIVE.SERDE2.OPENCSVSERDE Serde worked for me. My delimiter was '|' and one of the columns is enclosed in double quotes.

    Query:

    CREATE EXTERNAL TABLE EMAIL(MESSAGE_ID STRING, TEXT STRING, TO_ADDRS STRING, FROM_ADDRS STRING, SUBJECT STRING, DATE STRING)
    ROW FORMAT SERDE 'ORG.APACHE.HADOOP.HIVE.SERDE2.OPENCSVSERDE'
    WITH SERDEPROPERTIES (
         "SEPARATORCHAR" = "|",
         "QUOTECHAR"     = "\"",
         "ESCAPECHAR"    = "\""
    )    
    STORED AS TEXTFILE location '/user/abc/csv_folder';
    

提交回复
热议问题