getPersistentRDDs returns Map of cached RDDs and DataFrames in Spark 2.2.0, but in Spark 2.4.7 - it returns Map of cached RDDs only

后端 未结 0 1912
予麋鹿
予麋鹿 2020-12-19 19:20

If cache RDD and DataFrame in Spark version 2.2.0 getPersistentRDDs returns Map size 2:

scala> val rdd = sc.parallelize(Seq(1))
rdd: org.apache.spark.rdd.R         


        
相关标签:
回答
  • 消灭零回复
提交回复
热议问题