Kylin安装部署及使用示例

1. 下载Kylin安装包
   下载地址：
   http://kylin.apache.org/cn/download/
   
   或 https://archive.apache.org/dist/kylin/apache-kylin-2.6.0/
   
   linux下载Kylin安装包

   [root@node01 ~]# wget https://archive.apache.org/dist/kylin/apache-kylin-2.6.0/apache-kylin-2.6.0-bin-cdh57.tar.gz
   --2019-03-07 13:52:42--  https://archive.apache.org/dist/kylin/apache-kylin-2.6.0/apache-kylin-2.6.0-bin-cdh57.tar.gz
   Resolving archive.apache.org (archive.apache.org)... 163.172.17.199
   Connecting to archive.apache.org (archive.apache.org)|163.172.17.199|:443... connected.
   HTTP request sent, awaiting response... 200 OK
   Length: 353116590 (337M) [application/x-gzip]
   Saving to: ‘apache-kylin-2.6.0-bin-cdh57.tar.gz’
   
   100%[===================================================================================================================================================>] 353,116,590  174KB/s   in 39m 40s
   
   2019-03-07 14:32:23 (145 KB/s) - ‘apache-kylin-2.6.0-bin-cdh57.tar.gz’ saved [353116590/353116590]
   

2. 解压Kylin,并创建软连接

   [root@node01 kylin]# tar -zxvf apache-kylin-2.6.0-bin-cdh57.tar.gz  -C /usr/local/
   [root@node01 kylin]# cd /usr/local/
   [root@node01 kylin]# ln -s apache-kylin-2.6.0-bin/ kylin
   

3. 配置Kylin环境变量

   [root@node01 kylin]# cd /etc/profile.d
   [root@node01 profile.d]# touch kylin.sh
   [root@node01 profile.d]# vim kylin.sh 
   [root@node01 profile.d]# cat kylin.sh 
   export KYLIN_HOME=/usr/local/kylin
   export PATH=$PATH:$KYLIN_HOME/bin
   

4. 使环境变量立即生效,并验证环境变量是否配置成功
   source /etc/profile

   [root@node01 kylin]# bin/check-env.sh 
   Retrieving hadoop conf dir...
   KYLIN_HOME is set to /usr/local/kylin
   [root@node01 kylin]# 
   

5. 启动kylin服务
   执行bin/kylin.sh start命令

   [root@node01 kylin]# bin/kylin.sh start
   Retrieving hadoop conf dir...
   KYLIN_HOME is set to /usr/local/kylin
   Retrieving hive dependency...
   Retrieving hbase dependency...
   Retrieving hadoop conf dir...
   Retrieving kafka dependency...
   Retrieving Spark dependency...
   Start to check whether we need to migrate acl tables
   Retrieving hive dependency...
   Retrieving hbase dependency...
   Retrieving hadoop conf dir...
   Retrieving kafka dependency...
   Retrieving Spark dependency...
   Java HotSpot(TM) 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
   SLF4J: Class path contains multiple SLF4J bindings.
   ...
   2019-03-07 15:15:49,910 INFO  [close-hbase-conn] hbase.HBaseConnection:136 : Closing HBase connections...
   2019-03-07 15:15:49,912 INFO  [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:1830 : Closing zookeeper sessionid=0x3694ce7c739156e
   2019-03-07 15:15:49,926 INFO  [close-hbase-conn] zookeeper.ZooKeeper:684 : Session: 0x3694ce7c739156e closed
   2019-03-07 15:15:49,926 INFO  [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut down
   2019-03-07 15:15:49,947 INFO  [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:2259 : Closing master protocol: MasterService
   2019-03-07 15:15:49,947 INFO  [close-hbase-conn] client.ConnectionManager$HConnectionImplementation:1830 : Closing zookeeper sessionid=0x1694ce7c1551540
   2019-03-07 15:15:49,951 INFO  [Thread-7] zookeeper.ZooKeeper:684 : Session: 0x1694ce7c1551541 closed
   2019-03-07 15:15:49,951 INFO  [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut down
   2019-03-07 15:15:49,959 INFO  [close-hbase-conn] zookeeper.ZooKeeper:684 : Session: 0x1694ce7c1551540 closed
   2019-03-07 15:15:49,959 INFO  [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut down
   
   A new Kylin instance is started by root. To stop it, run 'kylin.sh stop'
   Check the log at /usr/local/kylin/logs/kylin.log
   Web UI is at http://<hostname>:7070/kylin
   

6. 访问kylin的web UI
   访问地址：http://node01:7070/kylin
   初始用户名: ADMIN
   初始密 码: KYLIN
   
   

7. 官方示例

   1. 执行bin/sample.sh,等待脚本执行完毕
   2. 查看Hive default库中的表,多了五张表
      
   3. 进入kylin Web界面登录 》System 》reload metadata
   4. 查看导入模型
      
   5. 构建cube
      
   6. 选择数据分区范围
      
   7. 点击monitor，查看正在构建cube的作业
      
   8. 刷新查看构建进度,等待构建完成
      这一步会比较耗时，因为这步会进行预计算，默认是MapReduce作业。
      
   9. 查询构建完成的cube
      在“Insight”选项卡中执行SQL

      select count(*) from KYLIN_SALES
      

      select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers 
      from kylin_sales group by part_dt order by part_dt
      

      
      多表关联查询,速度依然很快

      SELECT sum(KYLIN_SALES.PRICE) AS price_sum,
             KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME,
             KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME
      FROM KYLIN_SALES
      INNER JOIN KYLIN_CATEGORY_GROUPINGS ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID
      AND KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
      GROUP BY KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME,
               KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME
      ORDER BY KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME ASC,
               KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME DESC
      

      
      点击Visualization 可视化展示
      

遇到的问题：
无法加载 hive 中的数据库和表。
解决办法：
安装Kylin服务的节点上部署Hive Gateway