大数据之kudu安装

目前一直的kudu安装方式有三种

1、制作本地chd(镜像太大,几个G)

2、修改yum源,直接yum安装(半天下载不下来)

3、rpm安装

这里主要说的是第三种方式,rpm进行安装,到github下载一个rpm包就足够了

https://github.com/MartinWeindel/kudu-rpm/releases

我下载的是kudu-1.10.0-1.x86_64.rpm

集群方式进行安装

分发到每台机器后,直接执行命令rpm -ivh kudu-1.10.0-1.x86_64.rpm

安装完成后(每台集群都执行)

yum -y install ntp #安装ntp服务

service ntpd start #启动ntp服务

chkconfig ntpd on #设置开机启动

补充,kudu主要分master和tserver节点

修改master.gflagfile

[root@hadoop01 conf]# vim master.gflagfile

# cat /etc/kudu/conf/master.gflagfile

# Do not modify these two lines. If you wish to change these variables,

# modify them in /etc/default/kudu-master.

--fromenv=rpc_bind_addresses

--fromenv=log_dir

--fs_wal_dir=/export/servers/kudu/master

--fs_data_dirs=/export/servers/kudu/master

--master_addresses=node01:7051,node02:7051,node03:7051

修改tserver.gflagfile

[root@hadoop01 conf]# vim tserver.gflagfile

# Do not modify these two lines. If you wish to change these variables,

# modify them in /etc/default/kudu-tserver.

--fromenv=rpc_bind_addresses

--fromenv=log_dir

--fs_wal_dir=/export/servers/kudu/tserver

--fs_data_dirs=/export/servers/kudu/tserver

--tserver_master_addrs=node01:7051,node02:7051,node03:7051

修改一台后同步到另外两天机器

cd /etc/kudu/conf

scp -r master.gflagfile tserver.gflagfile node02:$PWD

scp -r master.gflagfile tserver.gflagfile node03:$PWD

cd /etc/default/

scp -r kudu-master kudu-tserver node02:$PWD

scp -r kudu-master kudu-tserver node03:$PWD

每台机器执行

mkdir -p /var/lib/kudu

chmod –R kudu:kudu /var/lib/kudu

启动kudu集群

分别执行以下命令,进行启动

service kudu-master start

service kudu-tserver start

启动集群后访问地址http://node01:8051/显示下图所示

大数据之kudu安装_第1张图片

关闭kudu集群

service kudu-master stop

service kudu-tserver stop

安装中遇到些问题,可以看日志/var/log/message

1、内存太小,启动失败,这个没有办法,只能加内存

2、

 master_main.cc:71] Check failed: _s.ok() Bad status:

Invalid argument: Unable to initialize catalog manager: Failed to initialize sys tables

async: on-disk master list

解决:

(1):停掉master和tserver

(2):删除掉之前所有的/export/servers/kudu/master/*和/export/servers/kudu/tserver/*

你可能感兴趣的:(java,hadoop,cloudera,大数据)