图像上色 (Image-Colorization) 论文、代码大汇总

基于深度学习的图像上色论文、代码、demo的大汇总。图像上色方式包括全自动上色（Automatic Colorization）和用户交互上色（User Guided / Interaction Colorization）。

Github上持续更新：https://github.com/MarkMoHR/Awesome-Image-Colorization

目录

• 全自动图像上色
• 用户交互图像上色
  • 基于颜色提示的上色
  • 基于彩色参考图的上色
  • 基于颜色色块的上色
  • 基于语言/文字的上色

---

1. 全自动图像上色

论文	发表处	代码/项目链接
Learning Large-Scale Automatic Image Colorization	ICCV 2015	[project] [code]
Deep Colorization	ICCV 2015
Learning Representations for Automatic Colorization	ECCV 2016	[project] [code]
Colorful Image Colorization	ECCV 2016	[project] [code]
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification	SIGGRAPH 2016	[project] [code]
Unsupervised Diverse Colorization via Generative Adversarial Networks	ECML-PKDD 2017	[code]
Learning Diverse Image Colorization	CVPR 2017	[code]
Structural Consistency and Controllability for Diverse Colorization	ECCV 2018
Pixelated Semantic Colorization	1901.10889

2. 用户交互图像上色

2.1 基于颜色提示的上色

图像类型	论文	发表处	代码/项目链接
漫画	Manga colorization	SIGGRAPH 2006
线稿 / 草图	Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks	1705.01908	[code]
灰度自然图像	Real-Time User-Guided Image Colorization with Learned Deep Priors	SIGGRAPH 2017	[project] [code1] [code2]
草图	Scribbler: Controlling Deep Image Synthesis with Sketch and Color	CVPR 2017
线稿	User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks	ACM MM 2018	[code]
线稿	Two-stage Sketch Colorization	SIGGRAPH Asia 2018	[code]
线稿 / 草图	Outline Colorization through Tandem Adversarial Networks	Online Demo	[Demo] [code]
线稿	Paints Chainer	Online Demo	[Demo] [code]
线稿	Style2paints	Online Demo	[Demo] [code]
漫画	MangaCraft	Online Demo	[Demo]

2.2 基于彩色参考图的上色

图像类型	论文	发表处	代码/项目链接
漫画	Comicolorization: Semi-Automatic Manga Colorization (also palette based)	SIGGRAPH Asia 2017	[code]
草图	TextureGAN: Controlling Deep Image Synthesis with Texture Patches	CVPR 2018	[code]
灰度自然图像	Deep Exemplar-based Colorization	SIGGRAPH 2018	[code]
灰度自然图像	Example-Based Colourization Via Dense Encoding Pyramids (also palette based)	Pacific Graphics 2018	[code]
灰度自然图像	A Superpixel-based Variational Model for Image Colorization	TVCG 2019

2.3 基于颜色色块的上色

图像类型	论文	发表处	代码/项目链接
自然图像	Palette-based Photo Recoloring	SIGGRAPH 2015	[project]
漫画	Comicolorization: Semi-Automatic Manga Colorization (also reference based)	SIGGRAPH Asia 2017	[code]
灰度自然图像	Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also text based)	ECCV 2018	[code]
灰度自然图像	Example-Based Colourization Via Dense Encoding Pyramids (also reference based)	Pacific Graphics 2018	[code]

2.4 基于语言/文字的上色

图像类型	论文	发表处	代码/项目链接
灰度自然图像 / 草图	Language-Based Image Editing with Recurrent Attentive Models	CVPR 2018	[code]
灰度自然图像	Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also palette based)	ECCV 2018	[code]
场景草图	LUCSS: Language-based User-customized Colorization of Scene Sketches	1808.10544	[code]