Why isn't Hadoop implemented using MPI?

前端 未结 6 891
一个人的身影
一个人的身影 2021-01-30 01:41

Correct me if I\'m wrong, but my understanding is that Hadoop does not use MPI for communication between different nodes.

What are the technical reasons for this?

<
6条回答
  •  误落风尘
    2021-01-30 02:21

    One of the big features of Hadoop/map-reduce is the fault tolerance. Fault tolerance is not supported in most (any?) current MPI implementations. It is being thought about for future versions of OpenMPI.

    Sandia labs has a version of map-reduce which uses MPI, but it lacks fault tolerance.

提交回复
热议问题