最近,Visual Transformer 的研究热点达到了前所未有的高峰,仅 CVPR 2021 就发表了 40 多篇,应用涉及:图像分类、目标检测、实例分割、语义分割、行为识别、自动驾驶、关键点匹配、目标跟踪、NAS、low-level视觉、HoI、可解释性、布局生成、检索、文本检测等方向。
引爆CV圈 Transformer热潮的有两篇最具代表性论文,即 ECCV 2020的 DETR(目标检测)和 ICLR 2021的 ViT(图像分类)。
目录
CVPR 2021 Visual Transformer 论文合集
必读的 20 篇必读 ViT 论文
Paper: https://arxiv.org/pdf/2012.09760.pdf
Code: https://github.com/microsoft/MeshTransformer
Paper: https://arxiv.org/pdf/2101.06184.pdf
Code: https://github.com/tobyperrett/trx
Paper: https://arxiv.org/pdf/2103.16110.pdf
Code: https://github.com/mczhuge/Kaleido-BERT
Paper: https://arxiv.org/pdf/2104.13682.pdf
Code: None
Paper: https://arxiv.org/pdf/2104.09224.pdf
Code: https://github.com/autonomousvision/transfuser
Paper: https://arxiv.org/pdf/2104.06976.pdf
Code: https://github.com/mlpc-ucsd/PRTR
Paper: https://arxiv.org/pdf/2104.02416.pdf
Code: None
Homepage: https://zju3dv.github.io/loftr/
Paper: https://arxiv.org/pdf/2104.00680.pdf
Code: https://github.com/zju3dv/LoFTR
中文解读:CVPR 2021 | 稀疏纹理也能匹配?速览基于Transformers的图像特征匹配器LoFTR
Paper: https://arxiv.org/pdf/2012.15840.pdf
Code: https://github.com/fudan-zvg/SETR
中文解读:CVPR 2021 | Transformer再下一城!复旦等提出SETR:语义分割网络
Paper: https://arxiv.org/pdf/2103.16553.pdf
Code: None
Paper: https://arxiv.org/pdf/2103.15436.pdf
Code: https://github.com/chenxin-dlut/TransT
Paper: https://arxiv.org/pdf/1811.10725.pdf
Code: None
Paper: https://arxiv.org/pdf/2103.11624.pdf
Code: https://decisionforce.github.io/mmTransformer
Paper: https://assets.amazon.science/1e/4c/93cb61584c9d959dcdea1bdfda9d/revamping-cross-modal-recipe-retrieval-with-hierarchical-transformers-and-self-supervised-learning.pdf
Code: https://github.com/amzn/image-to-recipe-transformers
Paper(Oral):https://arxiv.org/pdf/2103.11681.pdf
Code: https://github.com/594422814/TransformerTrack
Paper: https://arxiv.org/abs/2012.00364
Code: None
中文解读:CVPR 2021 | Transformer进军low-level视觉!北大华为等提出预训练模型IPT
Paper(Oral): https://arxiv.org/pdf/2011.14503.pdf
Code: https://github.com/Epiphqny/VisTR
中文解读:CVPR 2021 Oral | Transformer再突破!美团等提出VisTR:视频实例分割网络
Paper(Oral): https://arxiv.org/pdf/2011.09094.pdf
Code: https://github.com/dddzg/up-detr
中文解读:CVPR 2021 Oral | Transformer再发力!华南理工和微信提出UP-DETR:无监督预训练检测器
Paper: https://arxiv.org/pdf/2103.04503.pdf
Code: https://github.com/bbepoch/HoiTransformer
Paper: https://arxiv.org/pdf/2012.09838.pdf
Code: https://github.com/hila-chefer/Transformer-Explainability
Paper(Oral): https://arxiv.org/abs/2101.01909.pdf
Code: None
Paper: https://cs.jhu.edu/~alanlab/Pubs21/wang2021max.pdf
Code: None
Paper(Oral): https://arxiv.org/pdf/2101.08833.pdf
Code: https://github.com/dukebw/SSTVOS
Paper: https://arxiv.org/pdf/2012.05292.pdf
Code: None
Homepage: https://compvis.github.io/taming-transformers/
Paper(Oral): https://arxiv.org/pdf/2012.09841.pdf
Code: https://github.com/CompVis/taming-transformers
Paper(Oral): https://hehefan.github.io/pdfs/p4transformer.pdf
Code: None
Paper: https://arxiv.org/pdf/2011.14027.pdf
Code: None
Paper: https://arxiv.org/pdf/2101.11605.pdf
Code: None
中文解读:CNN+Transformer!谷歌提出BoTNet:新主干网络!在ImageNet上达84.7%准确率!
Paper(Oral): https://arxiv.org/pdf/2011.13922.pdf
Code: https://github.com/YicongHong/Recurrent-VLN-BERT
Paper(Oral): https://arxiv.org/pdf/2102.06183.pdf
Code: https://github.com/jayleicn/ClipBERT
Paper(Oral): https://arxiv.org/pdf/2103.12731.pdf
Code: None
下面是还没有公开的论文:
1. HR-NAS: Searching Efficient High-Resolution Neural Architectures with Transformers
Paper(Oral): None
Code: https://github.com/dingmyu/HR-NAS
2. Diverse Part Discovery: Occluded Person Re-Identification With Part-Aware Transformer
Paper: None
Code: None
3. LayoutTransformer: Scene Layout Generation With Conceptual and Spatial Diversity
Paper: None
Code: None
4. Facial Action Unit Detection With Transformers
Paper: None
Code: None
5. Clusformer: A Transformer Based Clustering Approach to Unsupervised Large-Scale Face and Visual Landmark Recognition
Paper: None
Code: None
6. Lesion-Aware Transformers for Diabetic Retinopathy Grading
Paper: None
Code: None
7. Adaptive Image Transformer for One-Shot Object Detection
Paper: None
Code: None
8. Multi-Stage Aggregated Transformer Network for Temporal Language Localization in Videos
Paper: None
Code: None
9. Self-Supervised Video Hashing via Bidirectional Transformers
Paper: None
Code: None
10. Gaussian Context Transformer
Paper: None
Code: None
11. Self-attention based Text Knowledge Mining for Text Detection
Paper: None
Code: https://github.com/CVI-SZU/STKM
12. SSAN: Separable Self-Attention Network for Video Representation Learning
Paper: None
Code: None
转自:https://mp.weixin.qq.com/s/CpmBY2qmvkxLiBmgy_PHJw