XXXX项目数据抽取工作小结

1、源端为Oracle时需要安装instantclient-basic-linux.x64-12.2.0.1.0,添加环境变量Oracle_home和LD_LIBRARY_PATH
export ORACLE_HOME=/opt/Oracle/instantclient_12_2
export LD_LIBRARY_PATH=/opt/Oracle/instantclient_12_2
2、当sqoop同步时出现RROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: oracle.jdbc.OracleDriver java.lang.RuntimeException: Could not load db driver class: oracle.jdbc.OracleDriver,在/usr/share/java中添加ojdbc6.jar,然后ln -s /usr/share/java/ojdbc6.jar /usr/hdp/2.15.3.0-37/sqoop/lib/ojdbc6.jar
3、sqoop抽取数据当出现提示表或者视图不存在时,将表名改为大写或许有用,听起来很扯,但是很有用,玄学吧!
4、sqoop抽取时如果多线程,需要根据主键切分

你可能感兴趣的:(XXXX项目数据抽取工作小结)