DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Error:

DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Solution:

1.修改进程最大文件打开数

/etc/security/limits.conf
# End of file
*               -      nofile          1000000
*               -      nproc           1000000

2.修改数据传输线程个数

hdfs-site.xml

in hadoop-1.x

    dfs.datanode.max.xcievers
    8192
    
        Specifies the maximum number of threads to use for transferring data
        in and out of the DN.
    

in hadoop-2.x

 
    dfs.datanode.max.transfer.threads 
    8192 
     
        Specifies the maximum number of threads to use for transferring data
        in and out of the DN.