keywords: hive query error, reduce phase error, datanote error

level: critical
evidence:
execute large overwrite operation, aborting in reduce phase
==datanote==
2012-06-14 22:42:33,445 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeRegistration(10.162.126.47:50010, storageID=DS-1453113558-10.162.126.47-50010-1337745298960, infoPort=50075, i
pcPort=50020):DataXceiver
java.io.IOException: xceiverCount 258 exceeds the limit of concurrent xcievers 256
        at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:165)
 
reason:
xcievers concurrent too low.
 
solution:
edit hdfs-site.xml
 
        dfs.datanode.max.xcievers
        4096