Spark SQL on ORC files doesn't return correct Schema (Column names)

后端 未结 5 1159
甜味超标
甜味超标 2020-12-21 09:55

I have a directory containing ORC files. I am creating a DataFrame using the below code

var data = sqlContext.sql(\"SELECT * FROM orc.`/directory/containing/         


        
5条回答
  •  臣服心动
    2020-12-21 10:03

    We can use:

    val df = hiveContext.read.table("tableName")

    Your df.schema or df.columns will give actual column names.

提交回复
热议问题