tez0.9.2 的使用 ui

1, 在编译后的tez 下找到 tez-ui-0.9.2.war. 用于部署前端ui使用
准备 tomcat .将war 解压到tmocat 下的webapps/tez下

//在webapps下新建tez目录
$ /usr/tomcat/default/webapps/tez
//将tez-ui解压到该目录下
$ unzip tez-ui-0.9.2.war
//修改配置文件,找到timeline server 和resource server

image.png

2,修改 yarn-site.xml,启用 timeline server

        yarn.timeline-service.enabled
        true
   

   
         yarn.resourcemanager.system-metrics-publisher.enabled
        true
   

   
        yarn.timeline-service.generic-application-history.enabled
        true
   

  
        yarn.timeline-service.hostname
        localhost
   

   
        yarn.timeline-service.http-cross-origin.enabled
        true
   
   
        Address for the Timeline server to start the RPC server.
        yarn.timeline-service.address
        localhost:10201
   
   
        The http address of the Timeline service web application.
        yarn.timeline-service.webapp.address
        localhost:8188
   
   
        The https address of the Timeline service web application.
        yarn.timeline-service.webapp.https.address
        localhost:2191
   
   
        yarn.timeline-service.handler-thread-count
        24
   

3,修改hive-site.xml.增加钩子函数,在tez ui中显示hive 信息.否则 hive queries tab页为空.

image.png

//添加以下三个钩子函数
 
    hive.exec.failure.hooks
    org.apache.hadoop.hive.ql.hooks.ATSHook
  
 
    hive.exec.post.hooks
    org.apache.hadoop.hive.ql.hooks.ATSHook
  
   
    hive.exec.pre.hooks
    org.apache.hadoop.hive.ql.hooks.ATSHook
  

4,修改$HADOOP_HOME/etc/hadoop/tez-site.xml .增加

  
        tez.history.logging.service.class
    org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService
    

        tez.tez-ui.history-url.base
        http://localhost:8880/tez/
    

访问 tomcat 的端口 http://localhost:8080/tez

知识点:
1, yarn 本身的命令中有一个 historyserver. 为什么还需要启用timelineserver 呢?
这是因为historyserver 是mapreduce的服务.就像 spark 有 history服务一样.而不是yarn本身的服务.有些概念的混淆.

2,timelineserver 未来规划会统一所有基于yarn开发的历史查询.
下面这个图很好的说明这点.

来自于参考链接

参考: https://blog.csdn.net/sinat_37690778/article/details/80594571