任务调度中心Azkaban安装指南

1.环境准备

1.jdk8
2.yum install gcc yum install gcc-c++

2.下载安装包

git clone [email protected]:azkaban/azkaban.git
git checkout 3.30.1 #指定版本

3.mysql配置

1 mysql> CREATE DATABASE azkaban;
2 mysql> CREATE USER ‘azkaban’@’%’ IDENTIFIED BY ‘azkaban’;
3 mysql> CREATE USER ‘azkaban’@‘localhost’ IDENTIFIED BY ‘azkaban’;
4 mysql> grant all privileges on azkaban.* to ‘azkaban’@’%’ identified by ‘azkaban’;
5 mysql> grant all privileges on azkaban.* to ‘azkaban’@‘localhost’ identified by ‘azkaban’;
6 mysql> flush privileges;

4.开始部署

4.1.解压文件

4.2.进入解压后的目录编译文件

./gradlew distTar

4.3.解压下面文件

./azkaban-3.47.0/azkaban-web-server/build/distributions/azkaban-web-server-0.1.0-SNAPSHOT.tar.gz
./azkaban-3.47.0/azkaban-solo-server/build/distributions/azkaban-solo-server-0.1.0-SNAPSHOT.tar.gz
./azkaban-3.47.0/azkaban-db/build/distributions/azkaban-db-0.1.0-SNAPSHOT.tar.gz

4.4.导入建表语句

mysql -uazkaban -p> SOURCE /./azkaban-3.47.0/azkaban-db/build/distributions/azkaban-db-0.1.0-SNAPSHOT/create-all-sql-0.1.0-SNAPSHOT.sql;

4.5.构建Azkaban-web-server

Mv /./azkaban-3.47.0/azkaban-web-server/build/distributions/azkaban-web-server-0.1.0-SNAPSHOT /./Azkaban-web-servercp -r /./azkaban-3.47.0/azkaban-solo-server/build/distributions/azkaban-solo-server-0.1.0-SNAPSHOT/conf /./Azkaban-web-server/conf

4.6.修改 /./Azkaban-web-server/conf/azkaban.properties 文件

#Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=Shuiwujia Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
#Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml
#Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=10.168.1.115
mysql.database=azkaban
mysql.user=azkaban
mysql.password=123456
mysql.numconnections=100

#Velocity dev mode
“conf/azkaban.properties” 49L, 1589C
#Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=Shuiwujia Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
#Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml
#Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=10.168.1.115
mysql.database=azkaban
mysql.user=azkaban
mysql.password=123456
mysql.numconnections=100

#Velocity dev mode
velocity.dev.mode=false
#Azkaban Jetty server properties.
jetty.use.ssl=false
jetty.maxThreads=25
jetty.port=8081
#Azkaban Executor settings
executor.port=12321
#mail settings
mail.sender=
mail.host=
#User facing web server configurations used to construct the user facing server URLs. They are useful when there is a reverse proxy between Azkaban web servers and users.
#enduser -> myazkabanhost:443 -> proxy -> localhost:8081
#when this parameters set then these parameters are used to generate email links.
#if these parameters are not set then jetty.hostname, and jetty.port(if ssl configured jetty.ssl.port) are used.
#azkaban.webserver.external_hostname=myazkabanhost.com
#azkaban.webserver.external_ssl_port=443
#azkaban.webserver.external_port=8081
job.failure.email=
job.success.email=
lockdown.create.projects=false
cache.directory=cache
#JMX stats
jetty.connector.stats=true
executor.connector.stats=true
#Azkaban plugin settings
azkaban.jobtype.plugin.dir=plugins/jobtypes

4.7.构建Azkaban-exec-server

tar -zxvf azkaban-exec-server-0.1.0-SNAPSHOT.tar.gz -C ./
mv azkaban-exec-server-0.1.0-SNAPSHOT Azkaban-exec-server

4.8./opt/Azkaban-exec-server目录下创建目录和文件conf/azkaban.properties文件

Azkaban Personalization Settings

default.timezone.id=Asia/Shanghai
#Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=10.168.1.115
mysql.database=azkaban
mysql.user=azkaban
mysql.password=123456
mysql.numconnections=100

#Azkaban Executor settings
executor.maxThreads=50
executor.port=12321
executor.flow.threads=30
#JMX stats
jetty.connector.stats=true
executor.connector.stats=true
#Azkaban plugin settings
azkaban.jobtype.plugin.dir=plugins/jobtypes

4.9.分别在/opt/Azkaban-web-server/conf和/opt/Azkaban-exec-server/conf目录下创建log4j.properties和global.properties（为空）文件

log4j.rootLogger=DEBUG,C
log4j.appender.C=org.apache.log4j.ConsoleAppender
log4j.appender.C.Target=System.err
log4j.appender.C.layout=org.apache.log4j.PatternLayout
log4j.appender.C.layout.ConversionPattern=%d{yyyy-MM-dd 	HH:mm:ss} %-5p %c{1}:%L - %m%n

4.10.分别在/opt/Azkaban-web-server/和/opt/Azkaban-exec-server/目录下创建plugins/jobtypes/commonprivate.properties目录和文件

azkaban.native.lib=false
execute.as.user=false

5.运行

Azkaban-exec-server目录下执行
1 bin/start-exec.sh
2 curl http://${ip}:12321/executor?action=activate

Azkaban-web-server目录下执行
bin/start-web.sh

http://10.168.1.115:8081/