语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut

DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
PAMI
Code : http://liangchiehchen.com/projects/DeepLab.html

本文针对深度卷积模型用于语义分割存在的三个问题分别提出对应的解决方法。
问题1: reduced feature resolution 特征图分辨率降低
问题2 :目标的尺度多样性
问题3: 分割的精确性差

对于问题1,特征图分辨率降低的原因是 一系列的 max-pooling and downsampling,我们的解决方法:去除了网络后面的一些降采样,使用了 atrous convolution 来提高分辨率(就是 dilated convolution)
对于老大难多尺度问题2:multiple scales,这里我们参考 spatial pyramid pooling 思想,提出了 atrous spatial pyramid pooling 来解决
对于问题3,我们使用 Conditional Random Field (CRF) 来提高分割的精度

Model Illustration
语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第1张图片

一维 atrous convolution 示意图
语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第2张图片

二维 atrous convolution 示意图
语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第3张图片

Atrous Spatial Pyramid Pooling
语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第4张图片

Conditional Random Field (CRF)
语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第5张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第6张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第7张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第8张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第9张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第10张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第11张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第12张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第13张图片

语义分割DeepLab v2--DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolut_第14张图片

你可能感兴趣的:(语义分割,语义分割)