Spark算子分类

风格不统一 提交于 2020-08-08 09:40:42

Action算子

  • reduce
  • collect
  • count
  • first
  • take
  • takeSample
  • takeOrdered
  • saveAsTextFile
  • saveAsSequenceFile
  • saveAsObjectFile
  • countByKey
  • foreach

Shuffle算子

  • distinct
  • reduceByKey
  • groupBy
  • groupByKey
  • aggregateByKey
  • combineByKey
  • sortByKey
  • sortBy
  • coalesce
  • repartition
  • intersection
  • subtract
  • subtractByKey
  • join
  • leftOuterJoin

Transformation算子

  • map
  • filter
  • flatMap
  • mapPartitions
  • mapPartitionsWithIndex
  • sample
  • union
  • intersection
  • distinct
  • groupByKey
  • reduceByKey
  • aggregateByKey
  • sortByKey
  • join
  • cogroup
  • cartesian
  • pipe
  • coalesce
  • repartition
  • repartitionAndSortWithinPartitions
标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!