执行python的map reduce出错 io.IOException: Broken pipe lang.RuntimeException: PipeMapRed.waitO

来源:http://stackoverflow.com/questions/5890188/hadoop-streaming-job-failed-in-python


java. io.IOException: Broken pipe 解决

-mapper  "python ./mapper.py"
-reducer "python ./reducer.py" 

Try to enclose your input path in double quotes. (-input "/data/omni/20110115/exp6-10122")


lang.RuntimeException: PipeMapRed.waitOutputThreads()解决

hadoop jar hadoop-streaming*.jar  
-D stream.non.zero.exit.is.failure=false  



你可能感兴趣的:(执行python的map reduce出错 io.IOException: Broken pipe lang.RuntimeException: PipeMapRed.waitO)