I want to write a large data frame (150 go) in hdfs with spark. so I did:
df.coalesce(10).write.option("header",true).option("delimiter",&