【sqoop2】sqoop-1.99.7安装

sqoop2安装

下载和解压
http://ftp.wayne.edu/apache/sqoop/
# tar -zxvf sqoop-1.99.7-bin-hadoop200.tar.gz -C /opt
# mv /opt/sqoop-1.99.7-bin-hadoop200 /opt/sqoop


$ vi conf/sqoop.properties
添加
# 设置日志文件的目录
0,%s/@LOGDIR@/\/opt\/sqoop\/logs/g
# 设置数据的存放目录
0,%s/@BASEDIR@/\/opt\/sqoop\/bin\/BASEDIR/g

org.apache.sqoop.security.authentication.type=SIMPLE
org.apache.sqoop.security.authentication.handler=org.apache.sqoop.security.authentication.SimpleAuthenticationHandler
org.apache.sqoop.security.authentication.anonymous=true


修改
org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/opt/hadoop3/etc/hadoop

注:
”\“为转义


在hadoop环境下的$HADOOP_HOME/etc/hadoop/core-site.xml添加
   
        hadoop.proxyuser.sqoop2.hosts
        *
   

   
        hadoop.proxyuser.sqoop2.groups
        *
   

    
添加 mysql 的驱动
$ cp /home/hadoop/tmp/mysql-connector-java-5.1.46-bin.jar /opt/sqoop/server/lib/

删除lib里derby-10.8.2.2.jar包,因这个包太旧了,从hive的lib拷贝一个derby-10.14.1.0.jar版本的过来

#验证
sqoop2-tool upgrade
sqoop2-tool verify

启动
sqoop2-server start

查看进程
jps

你可能感兴趣的:(大数据)