Spark: how to use SparkContext.textFile for local file system

后端 未结 6 1650
太阳男子
太阳男子 2020-12-06 01:36

I\'m just getting started using Apache Spark (in Scala, but the language is irrelevant). I\'m using standalone mode and I\'ll want to process a text file f

6条回答
  •  旧时难觅i
    2020-12-06 01:47

    Each node should contain a whole file. In this case local file system will be logically indistinguishable from the HDFS, in respect to this file.

提交回复
热议问题