Sqoop导入Oracle所有表，没有报错，但失败
1、导入到HDFS
[root@node1 sqoop-1.4.7]# bin/sqoop-import-all-tables --connect jdbc:oracle:thin:@node1:1521:ORA --username TEST --password test --as-textfile --warehouse-dir /user/root
Warning: /opt/sqoop-1.4.7/bin/../../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
18/05/24 16:40:18 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
18/05/24 16:40:18 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/05/24 16:40:18 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
18/05/24 16:40:18 INFO manager.SqlManager: Using default fetchSize of 1000
18/05/24 16:40:32 INFO manager.OracleManager: Time zone has been set to GMT
[root@node1 sqoop-1.4.7]#3、导入到Hive
[root@node1 sqoop-1.4.7]# bin/sqoop import-all-tables --connect jdbc:oracle:thin:@node1:1521:ORA --username TEST --password test --hive-import --create-hive-table --hive-overwrite
Warning: /opt/sqoop-1.4.7/bin/../../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
18/05/24 16:29:10 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
18/05/24 16:29:10 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/05/24 16:29:10 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
18/05/24 16:29:10 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
18/05/24 16:29:11 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
18/05/24 16:29:11 INFO manager.SqlManager: Using default fetchSize of 1000
18/05/24 16:29:31 INFO manager.OracleManager: Time zone has been set to GMT
[root@node1 sqoop-1.4.7]#没有报错，当然没有导入到Hive。暂时没有找到问题原因，先占坑标记一下。
3、问题分析
import-all-tables导入多表，必须同时满足三个条件：
- 每个表必须都只有一个列作为主键；
- 必须将每个表中所有的数据导入，而不是部分；
- 必须使用默认分隔列，且WHERE子句无任何强加的条件
也许是因为某些数据表的主键是多字段联合主键。
4、换个数据库试试
[root@node1 sqoop-1.4.7]# bin/sqoop-import-all-tables --connect jdbc:oracle:thin:@node2:1521:ORA_TEST --username TEST --password test --as-textfile --warehouse-dir /user/root -m 1
Warning: /opt/sqoop-1.4.7/bin/../../hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
18/05/24 17:19:11 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
18/05/24 17:19:12 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
18/05/24 17:19:12 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
18/05/24 17:19:12 INFO manager.SqlManager: Using default fetchSize of 1000
18/05/24 17:19:26 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:19:26 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:19:26 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:19:26 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb120180103 t WHERE 1=0
18/05/24 17:19:26 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb120180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:19:28 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb120180103.jar
18/05/24 17:19:28 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:19:28 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:19:28 INFO mapreduce.ImportJobBase: Beginning import of tb120180103
18/05/24 17:19:28 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
18/05/24 17:19:28 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:19:29 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
18/05/24 17:19:29 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:19:31 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:19:31 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:19:32 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0030
18/05/24 17:19:32 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0030
18/05/24 17:19:32 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0030/
18/05/24 17:19:32 INFO mapreduce.Job: Running job: job_1526097883376_0030
18/05/24 17:19:39 INFO mapreduce.Job: Job job_1526097883376_0030 running in uber mode : false
18/05/24 17:19:39 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:20:03 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:20:03 INFO mapreduce.Job: Job job_1526097883376_0030 completed successfully
18/05/24 17:20:03 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142573
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=3684204
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=21747
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=21747
Total vcore-milliseconds taken by all map tasks=21747
Total megabyte-milliseconds taken by all map tasks=22268928
Map-Reduce Framework
Map input records=25788
Map output records=25788
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=88
CPU time spent (ms)=5070
Physical memory (bytes) snapshot=221409280
Virtual memory (bytes) snapshot=2129108992
Total committed heap usage (bytes)=111149056
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=3684204
18/05/24 17:20:03 INFO mapreduce.ImportJobBase: Transferred 3.5135 MB in 34.5876 seconds (104.0216 KB/sec)
18/05/24 17:20:03 INFO mapreduce.ImportJobBase: Retrieved 25788 records.
18/05/24 17:20:03 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:20:04 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:04 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM RT_FIX_TRADE_DETAIL20180103 t WHERE 1=0
18/05/24 17:20:04 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/RT_FIX_TRADE_DETAIL20180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:20:04 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/RT_FIX_TRADE_DETAIL20180103.jar
18/05/24 17:20:04 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:04 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:04 INFO mapreduce.ImportJobBase: Beginning import of RT_FIX_TRADE_DETAIL20180103
18/05/24 17:20:04 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:04 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:20:06 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:20:06 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:20:06 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0031
18/05/24 17:20:06 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0031
18/05/24 17:20:06 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0031/
18/05/24 17:20:06 INFO mapreduce.Job: Running job: job_1526097883376_0031
18/05/24 17:20:14 INFO mapreduce.Job: Job job_1526097883376_0031 running in uber mode : false
18/05/24 17:20:14 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:20:21 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:20:21 INFO mapreduce.Job: Job job_1526097883376_0031 completed successfully
18/05/24 17:20:21 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142745
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=1270454
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=4936
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=4936
Total vcore-milliseconds taken by all map tasks=4936
Total megabyte-milliseconds taken by all map tasks=5054464
Map-Reduce Framework
Map input records=5412
Map output records=5412
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=77
CPU time spent (ms)=3450
Physical memory (bytes) snapshot=244133888
Virtual memory (bytes) snapshot=2157223936
Total committed heap usage (bytes)=109051904
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=1270454
18/05/24 17:20:21 INFO mapreduce.ImportJobBase: Transferred 1.2116 MB in 16.7667 seconds (73.9967 KB/sec)
18/05/24 17:20:21 INFO mapreduce.ImportJobBase: Retrieved 5412 records.
18/05/24 17:20:21 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:20:21 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:21 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb220180103 t WHERE 1=0
18/05/24 17:20:21 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb220180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:20:21 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb220180103.jar
18/05/24 17:20:21 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:21 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:21 INFO mapreduce.ImportJobBase: Beginning import of tb220180103
18/05/24 17:20:21 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:20:22 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:20:23 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:20:23 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:20:23 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0032
18/05/24 17:20:23 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0032
18/05/24 17:20:23 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0032/
18/05/24 17:20:23 INFO mapreduce.Job: Running job: job_1526097883376_0032
18/05/24 17:20:30 INFO mapreduce.Job: Job job_1526097883376_0032 running in uber mode : false
18/05/24 17:20:30 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:21:01 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:21:01 INFO mapreduce.Job: Job job_1526097883376_0032 completed successfully
18/05/24 17:21:01 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142678
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=227847981
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=27803
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=27803
Total vcore-milliseconds taken by all map tasks=27803
Total megabyte-milliseconds taken by all map tasks=28470272
Map-Reduce Framework
Map input records=1344627
Map output records=1344627
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=334
CPU time spent (ms)=27970
Physical memory (bytes) snapshot=249081856
Virtual memory (bytes) snapshot=2157604864
Total committed heap usage (bytes)=118489088
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=227847981
18/05/24 17:21:01 INFO mapreduce.ImportJobBase: Transferred 217.2928 MB in 39.2224 seconds (5.54 MB/sec)
18/05/24 17:21:01 INFO mapreduce.ImportJobBase: Retrieved 1344627 records.
18/05/24 17:21:01 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:21:01 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:01 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb320180103 t WHERE 1=0
18/05/24 17:21:01 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb320180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:21:01 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb320180103.jar
18/05/24 17:21:01 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:01 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:01 INFO mapreduce.ImportJobBase: Beginning import of tb320180103
18/05/24 17:21:01 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:01 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:21:02 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:21:02 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:21:02 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0033
18/05/24 17:21:03 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0033
18/05/24 17:21:03 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0033/
18/05/24 17:21:03 INFO mapreduce.Job: Running job: job_1526097883376_0033
18/05/24 17:21:10 INFO mapreduce.Job: Job job_1526097883376_0033 running in uber mode : false
18/05/24 17:21:10 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:21:42 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:21:42 INFO mapreduce.Job: Job job_1526097883376_0033 completed successfully
18/05/24 17:21:42 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142714
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=253608063
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=30321
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=30321
Total vcore-milliseconds taken by all map tasks=30321
Total megabyte-milliseconds taken by all map tasks=31048704
Map-Reduce Framework
Map input records=1046131
Map output records=1046131
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=325
CPU time spent (ms)=26670
Physical memory (bytes) snapshot=222507008
Virtual memory (bytes) snapshot=2144673792
Total committed heap usage (bytes)=117964800
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=253608063
18/05/24 17:21:42 INFO mapreduce.ImportJobBase: Transferred 241.8595 MB in 40.7716 seconds (5.9321 MB/sec)
18/05/24 17:21:42 INFO mapreduce.ImportJobBase: Retrieved 1046131 records.
18/05/24 17:21:42 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:21:42 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:42 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb420180103 t WHERE 1=0
18/05/24 17:21:42 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb420180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:21:42 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb420180103.jar
18/05/24 17:21:42 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:42 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:42 INFO mapreduce.ImportJobBase: Beginning import of tb420180103
18/05/24 17:21:42 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:21:42 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:21:43 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:21:43 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:21:43 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0034
18/05/24 17:21:44 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0034
18/05/24 17:21:44 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0034/
18/05/24 17:21:44 INFO mapreduce.Job: Running job: job_1526097883376_0034
18/05/24 17:21:51 INFO mapreduce.Job: Job job_1526097883376_0034 running in uber mode : false
18/05/24 17:21:51 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:22:02 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:22:02 INFO mapreduce.Job: Job job_1526097883376_0034 completed successfully
18/05/24 17:22:02 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142565
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=27949500
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=8584
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=8584
Total vcore-milliseconds taken by all map tasks=8584
Total megabyte-milliseconds taken by all map tasks=8790016
Map-Reduce Framework
Map input records=270054
Map output records=270054
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=132
CPU time spent (ms)=10240
Physical memory (bytes) snapshot=228392960
Virtual memory (bytes) snapshot=2144014336
Total committed heap usage (bytes)=114294784
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=27949500
18/05/24 17:22:02 INFO mapreduce.ImportJobBase: Transferred 26.6547 MB in 19.5005 seconds (1.3669 MB/sec)
18/05/24 17:22:02 INFO mapreduce.ImportJobBase: Retrieved 270054 records.
18/05/24 17:22:02 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:22:02 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:02 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb520180103 t WHERE 1=0
18/05/24 17:22:02 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb520180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:22:02 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb520180103.jar
18/05/24 17:22:02 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:02 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:02 INFO mapreduce.ImportJobBase: Beginning import of tb520180103
18/05/24 17:22:02 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:02 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:22:03 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:22:03 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:22:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0035
18/05/24 17:22:03 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0035
18/05/24 17:22:03 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0035/
18/05/24 17:22:03 INFO mapreduce.Job: Running job: job_1526097883376_0035
18/05/24 17:22:12 INFO mapreduce.Job: Job job_1526097883376_0035 running in uber mode : false
18/05/24 17:22:12 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:22:26 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:22:27 INFO mapreduce.Job: Job job_1526097883376_0035 completed successfully
18/05/24 17:22:27 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142461
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=1180571
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=12471
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=12471
Total vcore-milliseconds taken by all map tasks=12471
Total megabyte-milliseconds taken by all map tasks=12770304
Map-Reduce Framework
Map input records=14209
Map output records=14209
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=98
CPU time spent (ms)=3830
Physical memory (bytes) snapshot=214745088
Virtual memory (bytes) snapshot=2134482944
Total committed heap usage (bytes)=105906176
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=1180571
18/05/24 17:22:27 INFO mapreduce.ImportJobBase: Transferred 1.1259 MB in 24.6292 seconds (46.8103 KB/sec)
18/05/24 17:22:27 INFO mapreduce.ImportJobBase: Retrieved 14209 records.
18/05/24 17:22:27 INFO tool.CodeGenTool: Beginning code generation
18/05/24 17:22:27 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM tb620180103 t WHERE 1=0
18/05/24 17:22:27 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.7.5
Note: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb620180103.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/05/24 17:22:27 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/27cdb0f39b3a3dda1d10f6ebcd7a4f4e/tb620180103.jar
18/05/24 17:22:27 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:27 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:27 INFO mapreduce.ImportJobBase: Beginning import of tb620180103
18/05/24 17:22:27 INFO manager.OracleManager: Time zone has been set to GMT
18/05/24 17:22:27 INFO client.ConfiguredRMFailoverProxyProvider: Failing over to rm2
18/05/24 17:22:28 INFO db.DBInputFormat: Using read commited transaction isolation
18/05/24 17:22:28 INFO mapreduce.JobSubmitter: number of splits:1
18/05/24 17:22:28 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1526097883376_0036
18/05/24 17:22:29 INFO impl.YarnClientImpl: Submitted application application_1526097883376_0036
18/05/24 17:22:29 INFO mapreduce.Job: The url to track the job: http://node1:8088/proxy/application_1526097883376_0036/
18/05/24 17:22:29 INFO mapreduce.Job: Running job: job_1526097883376_0036
18/05/24 17:22:36 INFO mapreduce.Job: Job job_1526097883376_0036 running in uber mode : false
18/05/24 17:22:36 INFO mapreduce.Job: map 0% reduce 0%
18/05/24 17:22:54 INFO mapreduce.Job: map 100% reduce 0%
18/05/24 17:22:54 INFO mapreduce.Job: Job job_1526097883376_0036 completed successfully
18/05/24 17:22:54 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=142702
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=87
HDFS: Number of bytes written=1064642
HDFS: Number of read operations=4
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Other local map tasks=1
Total time spent by all maps in occupied slots (ms)=15756
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=15756
Total vcore-milliseconds taken by all map tasks=15756
Total megabyte-milliseconds taken by all map tasks=16134144
Map-Reduce Framework
Map input records=4896
Map output records=4896
Input split bytes=87
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=81
CPU time spent (ms)=3430
Physical memory (bytes) snapshot=238542848
Virtual memory (bytes) snapshot=2156716032
Total committed heap usage (bytes)=111673344
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=1064642
18/05/24 17:22:54 INFO mapreduce.ImportJobBase: Transferred 1.0153 MB in 27.2051 seconds (38.2167 KB/sec)
18/05/24 17:22:54 INFO mapreduce.ImportJobBase: Retrieved 4896 records.
[root@node1 sqoop-1.4.7]#