"DataXceiver: java.io.IOException: Connection reset by peer" erro

最近在跑mr任务的时候 ,查看datanode节点的log日志,总是会看到这个错误,仔细的查了下发现有人提过这个bug,如下:

When a client reads data using read(), it closes the sockets after it is done. Often it might not read till the end of a block. The datanode on the other side keeps writing data until the client connection is closed or end of the block is reached. If the client does not read till the end of the block, Datanode writes an error message and stack trace to the datanode log. It should not. This is not an error and it just pollutes the log and confuses the user.

下面是这个bug的修改地址
https://issues.apache.org/jira/browse/HADOOP-3678

你可能感兴趣的:(hadoop,bug,datanode)