Spark: Reading files using different delimiter than new line

前端 未结 5 1842
醉酒成梦
醉酒成梦 2020-11-28 08:01

I\'m using Apache Spark 1.0.1. I have many files delimited with UTF8 \\u0001 and not with the usual new line \\n. How can I read such files in Spar

5条回答
  •  悲哀的现实
    2020-11-28 08:30

    If you are using spark-context, the below code helped me sc.hadoopConfiguration.set("textinputformat.record.delimiter","delimeter")

提交回复
热议问题