本次事例环境:CentOS-6.5-x86_64-bin-DVD1.iso、jdk-8u161-linux-x64.rpm、hadoop-2.7.6.tar.gz
1、安装CentOS系统(最小化安装)
2、安装jdk:rpm -ivh jdk-8u161-linux-x64.rpm ,查询jdk安装路径:find / |grep java,测试jdk是否
安装成功:java -version
3、创建hadoop目录:mkdir /usr/local/hadoop ,将hadoop-2.7.6.tar.gz拷贝到目录下并解压:
tar -zxvf hadoop-2.7.6.tar.gz
4、配置hadoop环境变量:
[root@master hadoop-2.7.6]#vi etc/hadoop/hadoop-env.sh
export JAVA_HOME=/usr/java/jdk1.8.0_161
[root@master hadoop-2.7.6]#vi /etc/profile
export HADOOP_HOME=/usr/local/hadoop/hadoop-2.7.6
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
[root@master hadoop-2.7.6]#source /etc/profile
测试环境变量是否生效:hadoop version 或者 bin/hadoop version
5、修改hadoop核心配置文件:
[root@master hadoop-2.7.6]#vi etc/hadoop/core-site.xml
fs.defaultFS
hdfs://localhost:9000
[root@master hadoop-2.7.6]# vi etc/hadoop/hdfs-site.xml
dfs.replication
1
6、配置ssh免密登录:
》检查是否同时安装了openssh-clients和openssh-server软件:
rpm -qa |grep ssh 缺哪个装哪个:
yum -y install openssh-clients openssh-server
》启动ssh服务:service sshd start 或 service sshd restart
》配置ssh免密登录:
ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 0600 ~/.ssh/authorized_keys
》测试ssh免密登录:ssh localhost
7、初始化文件系统:[root@master hadoop-2.7.6]#
bin/hdfs namenode -format
8、启动名称节点和数据节点:[root@master hadoop-2.7.6]#
sbin/start-dfs.sh
(ps,要保证/etc/hosts解析与本机主机名一致,否则会报错)
9、浏览名称节点web接口:http://localhost:50070/ (ps,localhost为名称节点的IP地址或域名)
10、停止名称节点和数据节点[root@master hadoop-2.7.6]#
sbin/stop-dfs.sh