Hadoop 3.2.2 安装记录

下载地址：选择需要的版本

Index of /dist (apache.org)

docker环境准备：
docker run -itd --privileged=true --network=bridge-host --ip=192.168.0.221 --dns=114.114.114.114 --name hadoop221 -h hadoop221 --restart=always hadoop-base:v1 /usr/sbin/init
以上示例一个

 

在另外两台机器 slave1、slave2 上进行相同的配置。

 core-site.xml

fs.defaultFS
hdfs://hadoop220:9000


io.file.buffer.size
131072


hadoop.tmp.dir
file:/opt/apache/hadoop-3.2.2/tmp
Abasefor other temporary directories.


hadoop.proxyuser.spark.hosts
*


hadoop.proxyuser.spark.groups
*

 hdfs-site.xml

dfs.namenode.secondary.http-address
hadoop220:9001


dfs.namenode.name.dir
file:/opt/apache/hadoop-3.2.2/dfs/name


dfs.datanode.data.dir
file:/opt/apache/hadoop-3.2.2/dfs/data


dfs.replication
3


dfs.webhdfs.enabled
true

mapred-site.xm

mapreduce.framework.name
yarn


mapreduce.jobhistory.address
hadoop220:10020


mapreduce.jobhistory.webapp.address
hadoop220:19888

yarn-site.xml

yarn.nodemanager.aux-services
mapreduce_shuffle


yarn.nodemanager.aux-services.mapreduce.shuffle.class
org.apache.hadoop.mapred.ShuffleHandler


yarn.resourcemanager.address
hadoop220:8032


yarn.resourcemanager.scheduler.address
hadoop220:8030


yarn.resourcemanager.resource-tracker.address
hadoop220:8035


yarn.resourcemanager.admin.address
hadoop220:8033


yarn.resourcemanager.webapp.address
hadoop220:8088

改 works 文件，