sqoop安装

sqoop安装

作为大数据协作框架之一，Sqoop是一款用于Hadoop和关系型数据库之间进行相互的数据导入和导出的工具。
安装sqoop的前提是已经具备java和hadoop的环境
1、下载并解压
最新版下载地址http://ftp.wayne.edu/apache/sqoop/1.4.6/
2、修改配置文件

$ cd /usr/local/sqoop/conf
$ mv sqoop-env-template.sh sqoop-env.sh
打开sqoop-env.sh并编辑下面几行：
export HADOOP_COMMON_HOME=/home/hadoop/apps/hadoop
export HADOOP_MAPRED_HOME=/home/hadoop/apps/hadoop
export HIVE_HOME=/home/hadoop/apps/hive

3、赋值全局变量

[hadoop@master sqoop]$ sudo vi ~/.bashrc 
追加：
export SQOOP_HOME=/usr/local/sqoop
export PATH=$PATH:$SQOOP_HOME/bin
使其有效：
[hadoop@master sqoop]$ source ~/.bashrc 

4、加入mysql的jdbc驱动包

cp  ~/app/hive/lib/mysql-connector-java-5.1.28.jar   /usr/local/sqoop/lib/

5、验证启动

$ cd /usr/local/sqoop/bin
$ sqoop-version

预期的输出：

15/12/17 14:52:32 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
Sqoop 1.4.6 git commit id 5b34accaca7de251fc91161733f906af2eddbe83
Compiled by abe on Fri Aug 1 11:19:26 PDT 2015

但是sqoop的sqoop-env.sh中是需要配置这些

#Set path to where bin/hadoop is available
export HADOOP_COMMON_HOME=/usr/local/hadoop

#Set path to where hadoop-*-core.jar is available
export HADOOP_MAPRED_HOME=/usr/local/hadoop

#set the path to where bin/hbase is available
#export HBASE_HOME=

#Set the path to where bin/hive is available
export HIVE_HOME=/usr/local/hive

#Set the path for where zookeper config dir is
#export ZOOCFGDIR=

但在/usr/local/sqoop/bin/configure-sqoop需要全部配好，否则配置不全就会报错，不过没有关系，不影响你的使用。

[hadoop@master sqoop]$ sqoop -version
Warning: /usr/lib/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
No such sqoop tool: -version. See 'sqoop help'.

好了着我们就算是配好了。