Split a large csv into multiple csv with spark

前端 未结 0 968
孤街浪徒
孤街浪徒 2020-12-08 03:59

I want to write a large data frame (150 go) in hdfs with spark. so I did:

df.coalesce(10).write.option("header",true).option("delimiter",&         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题