Mongo的导出工具mongoexport介绍

需求介绍:将mongodb中的数据以文件的方式导出:json或cvs格式

 

mongo 提供了mongoexport的工具,可以实现将库中的数据以json或cvs的格式输出到文件中。mongoexport位于mongo安装位置中的bin/目录下。

mongoexport具体用法如下所示:

1. 使用help查看参数说明

E:\data                                                                                 

λ mongoexport --help                                                                    

Usage:                                                                                  

  mongoexport <options>                                                                 

                                                                                        

Export data from MongoDB in CSV or JSON format.                                         

                                                                                        

See http://docs.mongodb.org/manual/reference/program/mongoexport/ for more information. 

                                                                                        

general options:                                                                        

      /help                      print usage                                            

      /version                   print the tool version and exit                        

                                                                                        

verbosity options:                                                                      

  /v, /verbose                   more detailed log output (include multiple             

                                 times for more verbosity, e.g. -vvvvv)                 

      /quiet                     hide all log output                                    

                                                                                        

connection options:                                                                     

  /h, /host:                     mongodb host to connect to                             

                                 (setname/host1,host2 for replica sets)                 

      /port:                     server port (can also use --host hostname:port)        

                                                                                        

authentication options:                                                                 

  /u, /username:                 username for authentication                            

  /p, /password:                 password for authentication                            

      /authenticationDatabase:   database that holds the user's credentials             

      /authenticationMechanism:  authentication mechanism to use                        

                                                                                        

namespace options:                                                                      

  /d, /db:                       database to use                                        

  /c, /collection:               collection to use                                      

                                                                                        

output options:                                                                         

  /f, /fields:                   comma separated list of field names (required          

                                 for exporting CSV) e.g. -f "name,age"                  

      /fieldFile:                file with field names - 1 per line                     

      /type:                     the output format, either json or csv                  

                                 (defaults to 'json')                                   

  /o, /out:                      output file; if not specified, stdout is used          

      /jsonArray                 output to a JSON array rather than one object          

                                 per line                                               

      /pretty                    output JSON formatted to be human-readable             

                                                                                        

querying options:                                                                       

  /q, /query:                    query filter, as a JSON string, e.g.,                  

                                 '{x:{$gt:1}}'                                          

  /k, /slaveOk                   allow secondary reads if available (default            

                                 true)                                                  

      /forceTableScan            force a table scan (do not use $snapshot)              

      /skip:                     number of documents to skip                            

      /limit:                    limit the number of documents to export                

      /sort:                     sort order, as a JSON string, e.g. '{x:1}'             

2. 用例说明:

将info库中student的所有信息以json格式导出到student_json.dat数据文件中

mongoexport -h 127.0.0.1 -u root -p 12345 -d info -c student --type=json -o E:\data\student_json.dat

输出:

{

    "id": 123,

    "name": "张三",

    "age": 12

}

{

    "id": 124,

    "name": "李四",

    "age": 15

}

 

将info库中student的id,name信息以json格式导出到student_json.dat数据文件中,并且限定“行数”是1

mongoexport -h 127.0.0.1 -u root -p 12345 -d info -c student --type=json -f id,name --limit=1 -o E:\data\student_json.dat

输出:

{

    "id": 1,

    "name": "张三"

}

 

将info库中student的所有信息以cvs格式导出到student_cvs.dat数据文件中

mongoexport -h 127.0.0.1 -u root -p 12345 -d info -c student --type=cvs  -o E:\data\student_cvs.dat

输出:

123,"张三",12

124,"李四",15

 

将info库student“表”的name=张三的信息以cvs格式导出到student_cvs.dat数据文件中

mongoexport -h 127.0.0.1 -u root -p 12345 -d info -c student --type=cvs -q{"name":"张三"} -o E:\data\student_cvs.dat

输出:

123,"张三",12

 注意:

a. --type=json 只是控制每一条“记录”是json格式,而整体的输出文件不是json 。如果想要控制整体的文件数据格式是json数组,则需要使用--jsonArray 参数控制

 

扩展:

导入工具mongoimport

Mongodb中的mongoimport工具可以把一个特定格式文件中的内容导入到指定的collection中。该工具可以导入JSON格式数据,也可以导入CSV格式数据。具体使用如下所示:

E:\data

λ mongoimport --help

Usage:

  mongoimport <options> <file>



Import CSV, TSV or JSON data into MongoDB. If no file is provided, mongoimport reads from stdin.



See http://docs.mongodb.org/manual/reference/program/mongoimport/ for more information.



general options:

      /help                      print usage

      /version                   print the tool version and exit



verbosity options:

  /v, /verbose                   more detailed log output (include multiple

                                 times for more verbosity, e.g. -vvvvv)

      /quiet                     hide all log output



connection options:

  /h, /host:                     mongodb host to connect to

                                 (setname/host1,host2 for replica sets)

      /port:                     server port (can also use --host hostname:port)



authentication options:

  /u, /username:                 username for authentication

  /p, /password:                 password for authentication

      /authenticationDatabase:   database that holds the user's credentials

      /authenticationMechanism:  authentication mechanism to use



namespace options:

  /d, /db:                       database to use

  /c, /collection:               collection to use



input options:

  /f, /fields:                   comma separated list of field names, e.g. -f

                                 name,age

      /fieldFile:                file with field names - 1 per line

      /file:                     file to import from; if not specified, stdin

                                 is used

      /headerline                use first line in input source as the field

                                 list (CSV and TSV only)

      /jsonArray                 treat input source as a JSON array

      /type:                     input format to import: json, csv, or tsv

                                 (defaults to 'json')



ingest options:

      /drop                      drop collection before inserting documents

      /ignoreBlanks              ignore fields with empty values in CSV and TSV

      /maintainInsertionOrder    insert documents in the order of their

                                 appearance in the input source

  /j, /numInsertionWorkers:      number of insert operations to run

                                 concurrently (defaults to 1)

      /stopOnError               stop importing at first insert/upsert error

      /upsert                    insert or update objects that already exist

      /upsertFields:             comma-separated fields for the query part of

                                 the upsert

      /writeConcern:             write concern options e.g. --writeConcern

                                 majority, --writeConcern '{w: 3, wtimeout:

                                 500, fsync: true, j: true}' (defaults to

                                 'majority')

参数说明:

-h:指明数据库宿主机的IP

-u:指明数据库的用户名

-p:指明数据库的密码

-d:指明数据库的名字

-c:指明collection的名字

-f:指明要导入那些列

 

示例:先删除students中的数据,并验证

> db.students.remove()
> db.students.find()
>
然后再导入上面导出的students.dat文件中的内容

mongoimport -d test -c students students.dat 

connected to: 127.0.0.1

imported 9 objects

 

参数说明:

-d:指明数据库名,本例中为test

-c:指明collection名,本例中为students

students.dat:导入的文件名

查询students集合中的数据

> db.students.find()

{ "_id" : ObjectId("5031143350f2481577ea81e5"), "classid" : 1, "age" : 20, "name" : "kobe" }

{ "_id" : ObjectId("5031144a50f2481577ea81e6"), "classid" : 1, "age" : 23, "name" : "nash" }

{ "_id" : ObjectId("5031145a50f2481577ea81e7"), "classid" : 2, "age" : 18, "name" : "james" }

{ "_id" : ObjectId("5031146a50f2481577ea81e8"), "classid" : 2, "age" : 19, "name" : "wade" }

{ "_id" : ObjectId("5031147450f2481577ea81e9"), "classid" : 2, "age" : 19, "name" : "bosh" }

{ "_id" : ObjectId("5031148650f2481577ea81ea"), "classid" : 2, "age" : 25, "name" : "allen" }

{ "_id" : ObjectId("5031149b50f2481577ea81eb"), "classid" : 1, "age" : 19, "name" : "howard" }

{ "_id" : ObjectId("503114a750f2481577ea81ec"), "classid" : 1, "age" : 22, "name" : "paul" }

{ "_id" : ObjectId("503114cd50f2481577ea81ed"), "classid" : 2, "age" : 24, "name" : "shane" }

> 

证明数据导入成功

上面演示的是导入JSON格式的文件中的内容,如果要导入CSV格式文件中的内容,则需要通过--type参数指定导入格式,具体如下所示:

先删除数据

> db.students.remove()

> db.students.find()

> 

再导入之前导出的students_csv.dat文件

mongoimport -d test -c students --type csv --headerline --file students_csv.dat 

connected to: 127.0.0.1

imported 10 objects

参数说明:

-type:指明要导入的文件格式

-headerline:指明第一行是列名,不需要导入

-file:指明要导入的文件

查询students集合,验证导入是否成功:

> db.students.find()

{ "_id" : ObjectId("503266029355c632cd118ad8"), "classid" : 1, "name" : "kobe", "age" : 20 }

{ "_id" : ObjectId("503266029355c632cd118ad9"), "classid" : 1, "name" : "nash", "age" : 23 }

{ "_id" : ObjectId("503266029355c632cd118ada"), "classid" : 2, "name" : "james", "age" : 18 }

{ "_id" : ObjectId("503266029355c632cd118adb"), "classid" : 2, "name" : "wade", "age" : 19 }

{ "_id" : ObjectId("503266029355c632cd118adc"), "classid" : 2, "name" : "bosh", "age" : 19 }

{ "_id" : ObjectId("503266029355c632cd118add"), "classid" : 2, "name" : "allen", "age" : 25 }

{ "_id" : ObjectId("503266029355c632cd118ade"), "classid" : 1, "name" : "howard", "age" : 19 }

{ "_id" : ObjectId("503266029355c632cd118adf"), "classid" : 1, "name" : "paul", "age" : 22 }

{ "_id" : ObjectId("503266029355c632cd118ae0"), "classid" : 2, "name" : "shane", "age" : 24 }

> 

说明已经导入成功

 

你可能感兴趣的:(mongoexport)