Unusual behavior of Reducer of map-reduce in Hadoop?

本小妞迷上赌 提交于 2019-12-13 20:40:02

问题


I am currently working in pseudo-distributed mode in Hadoop. The way my reduce function works is: For each key it will create a arraylist of its value and then will make an instance of a singleton class [ This class is present in a library so I cannot change it ]. It then call a method of this instance.

Now my problem is: Suppose the map function emits 2 keys, then the reducer will only process one key for the another one it will say that "Java.lang.exception" the class[ the singleton one] cannot be instantiated.

My concern is why this is happening? As in pseudo-distributed mode each reducer run a different JVM!

来源:https://stackoverflow.com/questions/17756491/unusual-behavior-of-reducer-of-map-reduce-in-hadoop

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!