Sqoop2常用命令介绍
命令行操作之Create Command
1、Create Connection Function
create connection --cid 1 说明：Create new connection object for connector with id <x>
sqoop:000> create connection --cid 1 Creating connection for connector with id 1 Please fill following values to create new connection object Name: jdbc Connection configuration JDBC Driver Class: com.mysql.jdbc.Driver JDBC Connection String: jdbc:mysql://hadoop000:3306/hive Username: root Password: **** JDBC Connection Properties: There are currently 0 values in the map: entry# Security related configuration options Max connections: 100 New connection was successfully created with validation status FINE and persistent id 5
2、Create Job Function
create job --xid 1 说明：Create new job object for connection with id <x>
create job --xid 1 --type import 说明：Create new job object with type <t> (import, export)
sqoop:000> create job --xid 5 --type import Creating job for connection with id 5 Please fill following values to create new job object Name: tbls_import Database configuration Schema name: hive Table name: TBLS Table SQL statement: Table column names: Partition column name: Nulls in partition column: Boundary query: Output configuration Storage type: 0 : HDFS Choose: 0 Output format: 0 : TEXT_FILE 1 : SEQUENCE_FILE Choose: 0 Compression format: 0 : NONE 1 : DEFAULT 2 : DEFLATE 3 : GZIP 4 : BZIP2 5 : LZO 6 : LZ4 7 : SNAPPY Choose: 0 Output directory: hdfs://hadoop000:8020/sqoop2/tbls/ Throttling resources Extractors: Loaders: New job was successfully created with validation status FINE and persistent id 3
命令行操作之Show Command
1、Show Server Function
说明：Show details about configuration connection to Sqoop server.
sqoop:000> show server --all Server host: localhost Server port: 12000 Server webapp: sqoop sqoop:000> show server --host Server host: localhost sqoop:000> show server --port Server port: 12000 sqoop:000> show server --webapp Server webapp: sqoop
2、Show Option Function
Show values of various client side options. This function will show all client options when called without arguments.
sqoop:000> show option --name verbose Verbose = false
3、Show Version Function
Show versions of both client and server as well as supported protocols.
sqoop:000> show version --all client version: Sqoop 1.99.3-cdh5.0.0 revision Unknown Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014 server version: Sqoop 1.99.3-cdh5.0.0 revision Unknown Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014 Protocol version: [1] sqoop:000> show version --client client version: Sqoop 1.99.3-cdh5.0.0 revision Unknown Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014 sqoop:000> show version --server server version: Sqoop 1.99.3-cdh5.0.0 revision Unknown Compiled by jenkins on Thu Mar 27 23:34:50 PDT 2014 sqoop:000> show version --protocol Protocol version: [1]
4、Show Connector Function
Show connector meta data - parameters that connectors need in order to create new connection and job objects.
show connector --all
5、
Show Connection Function
show connection -all show connection --xid 5
6、Show Job Function
show job --all show job --jid 4
命令行操作之Update Command
1、Update Connection Function
update connection --xid 1
2、Update Job Function
update job --jid 1
命令行操作之Delete Command
1、Delete Connection Function
delete connection --xid 1
2、Delete Job Function
delete job --jid 1
命令行操作之Clone Command
1、Clone Connection Function
clone connection --xid 3
2、Clone Job Function
clone job --jid 3
命令行操作之Submission Command
1、Submission Start Function
Start job (submit new submission). Starting already running job is considered as invalid operation.
start job --jid 3 -s
2、Submission Stop Function
Interrupt running job.
stop job --jid 3
3、Submission Status Function
Retrieve last status for given job.
status job --jid 3