基于文本的实例分割(Referring Image Segmentation) 论文、代码大汇总

基于文本的实例分割(Referring Image Segmentation) 论文、代码的大汇总。

Github上持续更新：https://github.com/MarkMoHR/Awesome-Referring-Image-Segmentation

目录

• 数据集
• 方法

---

1. 数据集

简称	论文	发表处	相关链接
ReferIt	Referit game: Referring to objects in photographs of natural scenes	EMNLP 2014	[project]
Google-Ref	Generation and comprehension of unambiguous object descriptions	CVPR 2016	[dataset]
UNC	Modeling context in referring expressions	ECCV 2016	[dataset]
UNC+	Modeling context in referring expressions	ECCV 2016	[dataset]
CLEVR-Ref+	CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressions	CVPR 2019	[project]

---

2. 方法

方法简称	论文	发表处	代码 / 项目链接
CMSA	Cross-Modal Self-Attention Network for Referring Image Segmentation	CVPR 2019
KWA	Key-Word-Aware Network for Referring Expression Image Segmentation	ECCV 2018	[code]
DMN	Dynamic Multimodal Instance Segmentation Guided by Natural Language Queries	ECCV 2018	[code]
RRN	Referring Image Segmentation via Recurrent Refinement Networks	CVPR 2018	[code]
MAttNet	MAttNet: Modular Attention Network for Referring Expression Comprehension	CVPR 2018	[code] [Demo]
RMI	Recurrent Multimodal Interaction for Referring Image Segmentation	ICCV 2017	[code]
LSTM-CNN	Segmentation from natural language expressions	ECCV 2016	[code] [project]