DataX安装及使用

安装

1、上传压缩包

2、解压

tar -zxvf datax.tar.gz -C /usr/local/soft/

3、配置环境变量

vim /etc/profile

source /etc/profile

使用

stream2stream

编写配置文件stream2stream.json

vim stream2stream.json

{
  "job": {
    "content": [
      {
        "reader": {
          "name": "streamreader",
          "parameter": {
            "sliceRecordCount": 10,
            "column": [
              {
                "type": "long",
                "value": "10"
              },
              {
                "type": "string",
                "value": "hello，你好，世界-DataX"
              }
            ]
          }
        },
        "writer": {
          "name": "streamwriter",
          "parameter": {
            "encoding": "UTF-8",
            "print": true
          }
        }
      }
    ],
    "setting": {
      "speed": {
        "channel": 5
       }
    }
  }
}

执行同步任务

datax.py stream2stream.json

运行结果