第一步：HADOOP-环境配置

所有机器执行

关闭防火墙

$ systemctl stop firewalld && systemctl disable firewalld

关闭selinux

$ setenforce 0
$ vim /etc/selinux/config
SELINUX=disabled

配置swappiness

$ sysctl -w vm.swappiness=10
$ echo vm.swappiness = 10 >> /etc/sysctl.conf
$ cat /proc/sys/vm/swappiness
10

关闭透明大页面

$ echo never > /sys/kernel/mm/transparent_hugepage/defrag
$ echo never > /sys/kernel/mm/transparent_hugepage/enabled
$ vim /etc/rc.d/rc.local
if test -f /sys/kernel/mm/transparent_hugepage/enabled; then

    echo never > /sys/kernel/mm/transparent_hugepage/enabled

fi
if test -f /sys/kernel/mm/transparent_hugepage/defrag; then
    echo never > /sys/kernel/mm/transparent_hugepage/defrag
fi
$ chmod +x /etc/rc.d/rc.local

文件句柄

$ vim /etc/security/limits.conf
* soft nofile 100000
* hard nofile 100000

时间服务器

$ yum install ntp ntpdate -y
$ systemctl start ntpd && systemctl enable ntpd

基础软件

$ yum install -y chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse fuse-libs redhat-lsb mod_ssl unzip lrzsz

JDK8

部署OpenJDK8