kettle链接hive的环境配置

kettle链接hive

1)首先将hive/lib目录的包导入到kettle目录D:\software\data-integration\plugins\pentaho-big-data-plugin\hadoop-configurations\cdh510\lib下(找到你安装的目录)

2)找到D:\software\data-integration\plugins\pentaho-big-data-plugin\hadoop-configurations\cdh510目录

文件core-site.xml  添加内容:





    fs.defaultFS

    hdfs://bigData01:9000





    hadoop.tmp.dir

    /opt/modules/hadoop-2.6.0-cdh5.13.0/data



文件hive-site.xml 添加内容:



    hive.metastore.local

    false





    hive.metastore.uris

    thrift://ip地址:9083





    hive.exec.reducers.bytes.per.reducer

    1073741824





    hive.support.concurrency

    true





    hive.server2.thrift.port
    
    10000





    hive.server2.thrift.min.worker.threads

    5





    hive.server2.thrift.max.worker.threads

    500





    hive.jdbc_passwd.auth.zjl

    123456



文件mapred-site.xml添加如下



    mapreduce.framework.name

    yarn

文件yarn-site.xml添加内容:



            yarn.nodemanager.aux-services

           mapreduce_shuffle

3)找到D:\software\data-integration\plugins\pentaho-big-data-plugin\hadoop-configurations\cdh510目录

将cdh510配置在D:\software\data-integration\plugins\pentaho-big-data-plugin目录下的plugin.properties文件

添加内容:active.hadoop.configuration=cdh510

 

你可能感兴趣的:(hive,kettle,hadoop)