cdh安装配置笔记

cdh 5.10 install
安装的时候建议parcel+自定义选组建模式的安装（少选组建，避免一下子安装太多以及个别组建的报错导致整体安装太卡以及不流畅）


1.jdk以及cdh的安装
rpm -qa | grep java
sudo yum -y remove ？
sudo yum --nogpgcheck localinstall cloudera-manager-daemons-*.rpm 
sudo yum --nogpgcheck localinstall cloudera-manager-server-*.rpm
sudo yum --nogpgcheck localinstall cloudera-manager-agent*
2.下载parcel 以及sha1+mainfest.json 扔到parcel-repo下 rename sha1 to sha
3.ssh 打通
4.配置hostname
/etc/cloudera-scm-agent/config.ini --hostname 
5.mysql 安装以及mysqlconnector jar包扔到 /usr/share/lib 下 ,执行scm_prepare_database.sh的脚本
sudo ./scm_prepare_database.sh mysql -h 10.172.36.1 -uroot -p123456 --scm-host 10.172.36.61 scm scm scm
6.出问题查日志 /var/log/cloudera-scm-server/*.log


常见问题
1.mysql 密码权限问题
ERROR 1819 (HY000): Your password does not satisfy the current policy requirements


set global validate_password_policy=0;
set global validate_password_mixed_case_count=0;  
set global validate_password_number_count=3;  
set global validate_password_special_char_count=0;  
set global validate_password_length=3;
grant all privileges on *.* to 'root'@'%' identified by '123456' with grant option;


2.一些操作系统参数可以调整
sysctl -w vm.swappiness=10
sudo echo 'never' > /sys/kernel/mm/transparent_hugepage/defrag
....