Maxcompute ODPS upload(主要看标红指令)

Last login: Tue Oct 23 18:36:10 on ttys001

xuqiongdeMacBook-Pro:~ xuqiong$ java -version

java version "1.8.0_191"

Java(TM) SE Runtime Environment (build 1.8.0_191-b12)

Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)

xuqiongdeMacBook-Pro:~ xuqiong$ cd //Users/xuqiong/odpscmd_public\ /bin 

xuqiongdeMacBook-Pro:bin xuqiong$ ls

_word.csv odpscmd.bat

anti_spam_retrain_model_data5.csv pregnancy_question_from_web

article_from_qbb_app qbb_anti_spam_model_retrain_data1

correct_word_corpus qbb_anti_spam_model_retrain_data2

data_for_sen2vec_from_odps qbb_text_29.csv

data_from_web.csv recipebook.csv

falconn spam_draw_back.csv

minganci.csv text_corpus.txt

odpscmd

xuqiongdeMacBook-Pro:bin xuqiong$ ./odpscmd

Aliyun ODPS Command Line Tool

Version 0.26.2

@Copyright 2016 Alibaba Cloud Computing Co., Ltd. All rights reserved.

New version 0.29.5 available! Try it now! http://repo.aliyun.com/odpscmd/

odps@ btime_analysis_test>tunel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut

                         >tunel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut;

FAILED: ODPS-0130161:[1,1] Parse exception - invalid token 'tunel'

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut;

Upload session: 201810231842380947df0b298a2c09

Start upload:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv

Using \r\n to split records

Upload in strict schema mode: true

Total bytes:9126357 Split input to 1 blocks

2018-10-23 18:42:38 scan block: '1'

java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at java.util.concurrent.FutureTask.report(FutureTask.java:122)

at java.util.concurrent.FutureTask.get(FutureTask.java:192)

at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:223)

at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:165)

at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:75)

at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)

at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)

at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)

at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)

Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)

at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:210)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:207)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.

FAILED: error occurred while running tunnel command

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut;

Upload session: 201810231844420e47df0b29ccd838

Start upload:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv

Using \r\n to split records

Upload in strict schema mode: true

Total bytes:9126357 Split input to 1 blocks

2018-10-23 18:44:42 scan block: '1'

java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at java.util.concurrent.FutureTask.report(FutureTask.java:122)

at java.util.concurrent.FutureTask.get(FutureTask.java:192)

at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:223)

at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:165)

at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:75)

at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)

at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)

at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)

at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)

Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)

at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:210)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:207)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.

FAILED: error occurred while running tunnel command

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv btime_analysis_test.test_merge_age_taskgrp_taskcut;

Upload session: 2018102318473731dcdb0b2be43b3c

Start upload:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv

Using \r\n to split records

Upload in strict schema mode: true

Total bytes:9126334 Split input to 1 blocks

2018-10-23 18:47:37 scan block: '1'

2018-10-23 18:47:37 scan block complete, blockid=1

2018-10-23 18:47:37 upload block: '1'

2018-10-23 18:47:45 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 10% 916.5 KB 130.9 KB/s

2018-10-23 18:47:51 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 14% 1.3 MB 100.1 KB/s

2018-10-23 18:48:00 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 18% 1.6 MB 73.7 KB/s

2018-10-23 18:48:05 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 39% 3.4 MB 129.4 KB/s

2018-10-23 18:48:11 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 52% 4.5 MB 140.5 KB/s

2018-10-23 18:48:16 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 62% 5.5 MB 147.4 KB/s

2018-10-23 18:48:21 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 78% 6.8 MB 162.5 KB/s

2018-10-23 18:48:27 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 88% 7.7 MB 160.9 KB/s

2018-10-23 18:48:41 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut2.csv 100% 8.7 MB 141.5 KB/s

2018-10-23 18:48:41 upload block complete, blockid=1

upload complete, average speed is 137.1 KB/s

OK

odps@ btime_analysis_test>help

                         >help;

Usage: help

       help [keyword1 keyword2 ...]

For example:

       help

       help create table

 

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut upload data from local file -c

                         >tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut upload data from local file -c;

FAILED: ODPS-0130161:[1,1] Parse exception - invalid token 'tunnel'

ODPS-0130161:[1,162] Parse exception - invalid token '-'

ODPS-0130161:[2,162] Parse exception - invalid token '-'

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut -c "gbk"

                         >tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcut.csv btime_analysis_test.test_merge_age_taskgrp_taskcut -c "gbk";

Warning: ODPS request failed:Read timed out, retryCount:1, will retry in 130 seconds.

Warning: ODPS request failed:connect timed out, retryCount:1, will retry in 130 seconds.

FAILED: ODPS-0130161:[1,1] Parse exception - invalid token 'tunnel'

odps@ btime_analysis_test>

odps@ btime_analysis_test>

odps@ btime_analysis_test>

odps@ btime_analysis_test>

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv btime_analysis_test.test_merge_age_taskgrp_taskcut -c "gbk";

Upload session: 20181023191132c2dbdb0b2a763f32

Start upload:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv

Using \r\n to split records

Upload in strict schema mode: true

Total bytes:9126357 Split input to 1 blocks

2018-10-23 19:11:32 scan block: '1'

java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at java.util.concurrent.FutureTask.report(FutureTask.java:122)

at java.util.concurrent.FutureTask.get(FutureTask.java:192)

at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:223)

at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:165)

at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:75)

at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)

at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)

at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)

at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)

Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, BIGINT:'totalday'  For input string: "totalday"content: totalday,taskgrp,task

offset: 2

 

at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)

at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:210)

at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:207)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.

FAILED: error occurred while running tunnel command

odps@ btime_analysis_test>tunnel upload /Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv btime_analysis_test.test_merge_age_taskgrp_taskcut -c "gbk";

Upload session: 201810231913301547df0b2a3e59b7

Start upload:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv

Using \r\n to split records

Upload in strict schema mode: true

Total bytes:9126334 Split input to 1 blocks

2018-10-23 19:13:30 scan block: '1'

2018-10-23 19:13:30 scan block complete, blockid=1

2018-10-23 19:13:30 upload block: '1'

2018-10-23 19:13:44 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 37% 3.3 MB 256.4 KB/s

2018-10-23 19:13:50 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 41% 3.6 MB 196.6 KB/s

2018-10-23 19:13:55 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 45% 4 MB 169.5 KB/s

2018-10-23 19:14:00 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 50% 4.4 MB 156.3 KB/s

2018-10-23 19:14:05 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 65% 5.7 MB 172.4 KB/s

2018-10-23 19:14:11 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 79% 6.9 MB 176.2 KB/s

2018-10-23 19:14:16 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 93% 8.1 MB 184.4 KB/s

2018-10-23 19:14:19 1:0:9126334:/Users/xuqiong/Desktop/parent3.0/test_merge_age_taskgrp_taskcutlocal.csv 100% 8.7 MB 185.7 KB/s

2018-10-23 19:14:19 upload block complete, blockid=1

upload complete, average speed is 178.2 KB/s

OK

odps@ btime_analysis_test>

你可能感兴趣的:(sql)