I have been trying to get the databricks library for reading CSVs to work. I am trying to read a TSV created by hive into a spark data frame using the scala api.
Her
All of the option parameters are passed in the option() function as below:
option()
val segments = sqlContext.read.format("com.databricks.spark.csv") .option("delimiter", "\t") .load("s3n://michaeldiscenza/data/test_segments")