Running a job using hadoop streaming and mrjob: PipeMapRed.waitOutputThreads(): subprocess failed with code 1

前端 未结 4 1605
隐瞒了意图╮
隐瞒了意图╮ 2020-12-06 02:35

Hey I\'m fairly new to the world of Big Data. I came across this tutorial on http://musicmachinery.com/2011/09/04/how-to-process-a-million-songs-in-20-minutes/

It d

4条回答
  •  失恋的感觉
    2020-12-06 02:52

    I faced the same problem when running , my mapper and reducer scripts were not executable.

    Adding #! /usr/bin/python at the top of my files fixed the issue.

提交回复
热议问题