Hawq安装搭建

环境列表

操作系统:centos 7 64位

Hawq版本:git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git

虚拟机主机列表

主机名

Ip

hawq1

192.168.204.201

hawq2

192.168.204.202

hawq3

192.168.204.203

参考资料:https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install

一hawq编译安装(root用户操作hawq1, 192.168.204.201)

1操作系统环境准备

安装centos7,设置主机名,关闭防火墙,关闭selinux

chkconfig iptables off

chkconfig ip6tables off

systemctl stop firewalld.service

sestatus  //查询

vi  /etc/selinux/config  //关闭selinux

2软件环境准备

curl -L"https://bintray.com/wangzw/rpm/rpm" -o/etc/yum.repos.d/bintray-wangzw-rpm.repo

yum install -y epel-release

yum makecache

yum install -y man passwd sudo tar whichgit mlocate links make bzip2 net-tools \

 autoconf automake libtool m4 gcc gcc-c++ gdb bison flex cmake gperfmaven indent \

 libuuid-devel krb5-devel libgsasl-devel expat-devel libxml2-devel \

 perl-ExtUtils-Embed pam-devel python-devel libcurl-devel snappy-devel \

 thrift-devel libyaml-devel libevent-devel bzip2-devel openssl-devel \

 openldap-devel protobuf-devel readline-devel net-snmp-devel apr-devel \

 libesmtp-devel xerces-c-devel python-pip json-c-devel libhdfs3-devel \

 apache-ivy java-1.7.0-openjdk-devel \

 openssh-clients openssh-server

yum install -y postgresql-devel

pip --retries=50 --timeout=300 installpg8000 simplejson unittest2 pycrypto pygresql pyyaml lockfile paramiko psi

pip --retries=50 --timeout=300 installhttp://darcs.idyll.org/~t/projects/figleaf-0.6.1.tar.gz

pip --retries=50 --timeout=300 installhttp://sourceforge.net/projects/pychecker/files/pychecker/0.8.19/pychecker-0.8.19.tar.gz/download

yum erase -y postgresql postgresql-libspostgresql-devel

 

碰到问题:

Transaction check error:

 file /usr/lib/systemd/system/blk-availability.service from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

 file /usr/sbin/blkdeactivate from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

 file /usr/share/man/man8/blkdeactivate.8.gz from install ofdevice-mapper-7:1.02.107-5.el7.x86_64 conflicts with file from packagelvm2-7:2.02.105-14.el7.x86_64

rpm -qa | grep lvm2

yum erase lvm2-2.02.105-14.el7.x86_64


3下载incubator-hawq

git clonehttps://git-wip-us.apache.org/repos/asf/incubator-hawq.git

4安装libyarn

cd depends/libyarn/

mkdir build

cd build

../bootstrap --prefix=/usr/local/

make

sudo make install

把结果*.so文件复制至/usr/lib或者如下操作

ln -s /usr/local/libyarn.so  /usr/lib

ln -s /usr/local/libyarn.so.1  /usr/lib

ln -s /usr/local/libyarn.so.0.1.10  /usr/lib

ldconfig

5配置及编译hawq(注意保持网络通畅)

./configure --prefix=/hawq

make

make install

二虚拟机制作

第一部分操作完成后,保存虚拟机hawq1,然后copy成2份,然后分别打开虚拟机根据虚拟机主机列表更改主机名,IP等操作,然后互ping IP,确认虚机机之间网络通畅。

三hadoop 2.X系统安装配置(可以利用gpssh设置互信等),然后启动运行,

hadoop 2.X系统安装配置参考:http://blog.csdn.net/sunziyue/article/details/50735192

之后再配置好hawq软件中相关配置文件(hawq用户操作)。

四初始化hawq实例(hawq用户操作)

source /install/dir/greenplum_path.sh

hawq init cluster

hawq stop/restart/start cluster

你可能感兴趣的:(hadoop2.X)