How to restore RDD of (key,value) pairs after it has been stored/read from a text file

后端 未结 2 913
爱一瞬间的悲伤
爱一瞬间的悲伤 2020-12-19 17:37

I saved my RDD of (key, value) pairs to a text file using saveAsTextFile. After I read the text file back using sc.textFile(\"filename.txt\") command, I ended u

2条回答
  •  自闭症患者
    2020-12-19 18:10

    You're going to have to implement a parser for your input. The easiest thing to do is to map your output to a character separated output with a tab or colon delimeter and use spilt(delimiter) in your map upon reading, basically like in the wordCount example.

提交回复
热议问题