Hadoop DistributedCache is deprecated - what is the preferred API?

前端 未结 6 1264
情深已故
情深已故 2020-11-28 04:14

My map tasks need some configuration data, which I would like to distribute via the Distributed Cache.

The Hadoop MapReduce Tutorial shows the usage of the Distribut

6条回答
  •  没有蜡笔的小新
    2020-11-28 05:19

    The new DistributedCache API for YARN/MR2 is found in the org.apache.hadoop.mapreduce.Job class.

       Job.addCacheFile()
    

    Unfortunately, there aren't as of yet many comprehensive tutorial-style examples of this.

    http://hadoop.apache.org/docs/stable/api/org/apache/hadoop/mapreduce/Job.html#addCacheFile%28java.net.URI%29

提交回复
热议问题