Reuse a cached Spark RDD

前端 未结 1 725
余生分开走
余生分开走 2021-01-21 13:53

Is there a possibility in Spark to re-use a cached RDD in another application (or in another run of the same application)?

JavaRDD toCache =          


        
1条回答
  •  野性不改
    2021-01-21 14:22

    No, Spark RDD cannot be used in other application or in another run.

    You can connect Spark with for example Hazelcast or Apache Ignite to save RDDs in memory. Other application will have possibility to read data saved in first application

    0 讨论(0)
提交回复
热议问题