aws导入镜像和导入快照，平滑迁云详解

 

目录

一、安装AWS CLI

1、linux 安装AWS CLI

2、配置AWS CLI

二、创建具有导入导出权限的角色

三、导入镜像

1、上传镜像到S3

2、导入镜像

3、查看导入的镜像

4、取消导入映像任务

四、导入快照

五、导出镜像

1、导出镜像到s3

2、查看导出状态

3、取消导出映像任务

六、总结

---

一、安装AWS CLI

1、linux 安装AWS CLI

官网：https://docs.amazonaws.cn/cli/latest/userguide/install-cliv2-linux.html

curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install

2、配置AWS CLI

首先AWS后台获取账号密钥对->使用aws configure配置认证

# aws configure
AWS Access Key ID [None]: AKIAQGMfdfsefd7Odf
AWS Secret Access Key [None]: JCKbGTfkkdjfdgrrZdpo8weSenCxooY
Default region name [None]: cn-northwest-1
Default output format [None]: json

二、创建具有导入导出权限的角色

1、新建文件trust-policy.json 放入

{
   "Version": "2012-10-17",
   "Statement": [
      {
         "Effect": "Allow",
         "Principal": { "Service": "vmie.amazonaws.com" },
         "Action": "sts:AssumeRole",
         "Condition": {
            "StringEquals":{
               "sts:Externalid": "vmimport"
            }
         }
      }
   ]
}

 

2、创建服务角色

 

# aws iam create-role --role-name vmimport --assume-role-policy-document file:///home/centos/trust-policy.json
{
    "Role": {
        "Path": "/",
        "RoleName": "vmimport",
        "RoleId": "AROAQGM5NM2MH4OH5OAVP",
        "Arn": "arn:aws-cn:iam::013751903896:role/vmimport",
        "CreateDate": "2020-05-14T08:34:46+00:00",
        "AssumeRolePolicyDocument": {
            "Version": "2012-10-17",
            "Statement": [
                {
                    "Effect": "Allow",
                    "Principal": {
                        "Service": "vmie.amazonaws.com"
                    },
                    "Action": "sts:AssumeRole",
                    "Condition": {
                        "StringEquals": {
                            "sts:Externalid": "vmimport"
                        }
                    }
                }
            ]
        }
    }

3、编写角色策略

创建名为 role-policy.json 的文件并编写下面的策略，其中，migrate-cloud-image 为存储磁盘映像的存储桶：

# cat role-policy.json
{
   "Version":"2012-10-17",
   "Statement":[
      {
         "Effect":"Allow",
         "Action":[
            "s3:GetBucketLocation",
            "s3:GetObject",
            "s3:ListBucket" 
         ],
         "Resource":[
            "arn:aws-cn:s3:::migrate-cloud-image",
            "arn:aws-cn:s3:::migrate-cloud-image/*"
         ]
      },
      {
         "Effect":"Allow",
         "Action":[
            "s3:GetBucketLocation",
            "s3:GetObject",
            "s3:ListBucket",
            "s3:PutObject",
            "s3:GetBucketAcl"
         ],
         "Resource":[
            "arn:aws-cn:s3:::export-image",
            "arn:aws-cn:s3:::export-image/*"
         ]
      },
      {
         "Effect":"Allow",
         "Action":[
            "ec2:ModifySnapshotAttribute",
            "ec2:CopySnapshot",
            "ec2:RegisterImage",
            "ec2:Describe*"
         ],
         "Resource":"*"
      }
   ]
}

4、策略和角色关联

使用put-role-policy命令将策略挂载到之前创建的角色，请指定 role-policy.json 文件位置的完整路径

aws iam put-role-policy --role-name vmimport --policy-name vmimport --policy-document file://role-policy.json

三、导入镜像

1、上传镜像到S3

参考：https://wangfanggang.com/AWS/AWS-CLI-S3-upload/

# aws s3 cp CentOS-7.6-64bit-huawei.vmdk s3://migrate-cloud-image/CentOS-7.6-64bit-huawei.vmdk
upload: ./CentOS-7.6-64bit-huawei.vmdk to s3://migrate-cloud-image/CentOS-7.6-64bit-huawei.vmdk

2、导入镜像

创建导入策略文件containers.json

[
  {
    "Description": "offline-data-disk",
    "Format": "vhd",
    "UserBucket": {
        "S3Bucket": "migrate-cloud-image",
        "S3Key": "offline-data-disk.vhd"
    }
  }
]

执行导入镜像

# aws ec2 import-image  --description "huawei server" --disk-containers file://containers.json             {
    "Description": "huawei server",
    "ImportTaskId": "import-ami-06f701b644dc0fd77",
    "Progress": "2",
    "SnapshotDetails": [
        {
            "DiskImageSize": 0.0,
            "Format": "VMDK",
            "UserBucket": {
                "S3Bucket": "migrate-cloud-image",
                "S3Key": "CentOS-7.6-64bit-huawei.vmdk"
            }
        }
    ],
    "Status": "active",
    "StatusMessage": "pending"
}

查看导入进度

使用 describe-import-image-tasks 命令返回导入任务的状态进度。

包括的状态值如下：
active — 正在运行导入任务。
deleting — 正在取消导入任务。
deleted — 导入任务已取消。
updating — 导入状态正在更新。
validating — 正在验证导入的映像。
validated — 已验证导入的映像。
converting — 正在将导入的映像转换成 AMI。
completed — 导入任务已完成，并且 AMI 已准备就绪，随时可以使用。

# aws ec2 describe-import-image-tasks --import-task-ids import-ami-06f701b644dc0fd77
{
    "ImportImageTasks": [
        {
            "Description": "huawei server",
            "ImportTaskId": "import-ami-06f701b644dc0fd77",
            "SnapshotDetails": [],
            "Status": "deleted",
            "StatusMessage": "ClientError: Disk validation failed [Unsupported VMDK File Format]",
            "Tags": []
        }
    ]
}

上面导入的vmdk格式，并未成功，后来导入的vhd成功。

导入完成

# aws ec2 describe-import-image-tasks --import-task-ids import-ami-0ab311a7d84fddee2
{
    "ImportImageTasks": [
        {
            "Architecture": "x86_64",
            "Description": "book-sync-server",
            "ImageId": "ami-0e3bceeecf00f1c13",
            "ImportTaskId": "import-ami-0ab311a7d84fddee2",
            "LicenseType": "BYOL",
            "Platform": "Linux",
            "SnapshotDetails": [
                {
                    "Description": "book-sync-service-image",
                    "DeviceName": "/dev/sda1",
                    "DiskImageSize": 41949169152.0,
                    "Format": "VHD",
                    "SnapshotId": "snap-0a52c455e54514e5f",
                    "Status": "completed",
                    "UserBucket": {
                        "S3Bucket": "migrate-cloud-image",
                        "S3Key": "book-sync-service-sysdisk.vhd"
                    }
                }
            ],
            "Status": "completed",
            "Tags": []
        }
    ]
}

3、查看导入的镜像

在启动实例->我的AMI就可以看到我导入进来的镜像了，可以用作安装机器了。

4、取消导入映像任务

若您需要取消处于活跃状态的导入任务，请使用 cancel-import-task 命令。

aws ec2 cancel-import-task --import-task-id import-ami-0ab311a7d84fddee2

四、导入快照

aws官网：https://docs.amazonaws.cn/vm-import/latest/userguide/vmimport-import-snapshot.html

1、使用场景及条件

使用场景：我们做云迁移时候可用通过快照方式将磁盘作为 Amazon EBS 快照导入，然后从快照创建 EBS 卷，将其挂载到某个 EC2 实例，从而达到迁移数据盘数据的目的。

使用条件：

• 支持以下磁盘格式：虚拟硬盘 (VHD/VHDX)、ESX 虚拟机磁盘 (VMDK)、原始格式。

• 首先，您必须将磁盘上传到 Amazon S3。

• 具有已经安装好AWS CLI命令的实例

2、创建导入策略json文件

containers-disk.json 内容如下：（offline-data-disk.vhd s3上传步骤略，看导入镜像部分）

{
    "Description": "offline-data-disk",
    "Format": "vhd",
    "UserBucket": {
        "S3Bucket": "migrate-cloud-image",
        "S3Key": "offline-data-disk.vhd"
    }
}

3、命令导入快照

# aws ec2 import-snapshot  --description "offline-disk-data" --disk-container file://containers-disk.json
{
    "Description": "offline-disk-data",
    "ImportTaskId": "import-snap-0f9f1a54ae3cfaac3",
    "SnapshotTaskDetail": {
        "Description": "offline-disk-data",
        "DiskImageSize": 0.0,
        "Format": "VHD",
        "Progress": "3",
        "Status": "active",
        "StatusMessage": "pending",
        "UserBucket": {
            "S3Bucket": "migrate-cloud-image",
            "S3Key": "offline-data-disk.vhd"
        }
    }
}

4、查看快照导入状态

# aws ec2 describe-import-snapshot-tasks --import-task-ids import-snap-0f9f1a54ae3cfaac3
{
    "ImportSnapshotTasks": [
        {
            "Description": "offline-disk-data",
            "ImportTaskId": "import-snap-0f9f1a54ae3cfaac3",
            "SnapshotTaskDetail": {
                "Description": "offline-disk-data",
                "DiskImageSize": 371493888.0,
                "Format": "VHD",
                "SnapshotId": "snap-06f9d2432a33e00c7",
                "Status": "completed",
                "UserBucket": {
                    "S3Bucket": "migrate-cloud-image",
                    "S3Key": "offline-data-disk.vhd"
                }
            },
            "Tags": []
        }
    ]
}

当状态变为completed说明导入完成。我们去后台ELASTIC BLOCK STORE->快照，就可以看到我们刚刚导入的快照了。

5、创建一个卷并将其附加到某个 EC2 实例

将卷挂载到的实例的可用区

#  aws ec2 create-volume --availability-zone cn-northwest-1c --snapshot-id snap-06f9d2432a33e00c7
{
    "AvailabilityZone": "cn-northwest-1c",
    "CreateTime": "2020-05-17T11:35:00+00:00",
    "Encrypted": false,
    "Size": 101,
    "SnapshotId": "snap-06f9d2432a33e00c7",
    "State": "creating",
    "VolumeId": "vol-0b01d8b1a69db9b1d",
    "Iops": 303,
    "Tags": [],
    "VolumeType": "gp2"
}

查看上面我们创建的卷,管理后台ELASTIC BLOCK STORE->卷

将卷关联到你的目标实例EC2

# aws ec2 attach-volume --volume-id vol-0b01d8b1a69db9b1d --instance-id i-07fec72fd87af22ff --device /dev/sdb
{
    "AttachTime": "2020-05-17T11:43:01.774000+00:00",
    "Device": "/dev/sdb",
    "InstanceId": "i-07fec72fd87af22ff",
    "State": "attaching",
    "VolumeId": "vol-0b01d8b1a69db9b1d"
}

EC2实例描述中查看刚挂载的卷

 

但是注意，最后还需要通过手动mount此卷到EC2实例

mount -t ext4 /dev/xvdb /opt

# df -h
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        472M     0  472M   0% /dev
tmpfs           495M     0  495M   0% /dev/shm
tmpfs           495M   13M  482M   3% /run
tmpfs           495M     0  495M   0% /sys/fs/cgroup
/dev/xvda1      180G  161G   20G  90% /
tmpfs            99M     0   99M   0% /run/user/1000
/dev/xvdb        99G  139M   94G   1% /opt

ps:其实将卷挂载到的实例的可用区后,我们可以在后台进行关联实例了，自己去研究吧。

五、导出镜像

官网：https://docs.amazonaws.cn/vm-import/latest/userguide/vmexport_image.html

参数S3Bucket为导出的bucket名字，S3Prefix是bucket路径

1、导出镜像到s3

# aws ec2 export-image --image-id ami-0c32dcd3405ad47eb --disk-image-format VHD --s3-export-location S3Bucket=export-image,S3Prefix=/
{
    "DiskImageFormat": "vhd",
    "ExportImageTaskId": "export-ami-00bfb78a9f3fce2a3",
    "ImageId": "ami-0c32dcd3405ad47eb",
    "RoleName": "vmimport",
    "Progress": "0",
    "S3ExportLocation": {
        "S3Bucket": "export-image",
        "S3Prefix": "/"
    },
    "Status": "active",
    "StatusMessage": "validating"
}

2、查看导出状态

# aws ec2 describe-export-image-tasks --export-image-task-ids export-ami-00bfb78a9f3fce2a3
{
    "ExportImageTasks": [
        {
            "ExportImageTaskId": "export-ami-00bfb78a9f3fce2a3",
            "Progress": "85",
            "S3ExportLocation": {
                "S3Bucket": "export-image",
                "S3Prefix": "/"
            },
            "Status": "active",
            "StatusMessage": "converting"
        }
    ]
}

3、取消导出映像任务

若有需要，您可以使用以下 cancel-export-task 命令取消正在进行的映像导出。

aws ec2 cancel-export-task --export-task-id export-ami-00bfb78a9f3fce2a3

如果导出任务完成或正在传输最后一个磁盘映像，则该命令将失败且会返回错误。

六、aws命令上传下载

下载

/usr/local/bin/aws s3 cp s3://export-image//export-ami-00bfb78a9f3fce2a3.vhd /home/centos/
download: s3://export-image//export-ami-00bfb78a9f3fce2a3.vhd to ./export-ami-00bfb78a9f3fce2a3.vhd

七、总结

经过测试，AWS导入vmdk不成功，接口提示不支持,vmdk非加密。使用vhd格式成功导入。

{
    "ImportImageTasks": [
        {
            "Description": "huawei server",
            "ImportTaskId": "import-ami-06f701b644dc0fd77",
            "SnapshotDetails": [],
            "Status": "deleted",
            "StatusMessage": "ClientError: Disk validation failed [Unsupported VMDK File Format]",
            "Tags": []
        }
    ]
}

抛去其他因素，利用AWS导入镜像和导入快照，我们可以将业务平滑迁移。

参考：

https://mhl.xyz/Windows/aws-AMI.html

https://blog.csdn.net/weixin_33796177/article/details/92989241