Very basic question about Hadoop and compressed input files

前端 未结 4 753
耶瑟儿~
耶瑟儿~ 2021-02-04 03:15

I have started to look into Hadoop. If my understanding is right i could process a very big file and it would get split over different nodes, however if the file is compressed t

4条回答
  •  刺人心
    刺人心 (楼主)
    2021-02-04 03:53

    You can use bz2 as your compress codec, and this format also can been split.

提交回复
热议问题