零样本学习近年文献总结

Zero-Shot Learning

该文作者总结了近些年在零样本领域的一些研究文章、开源代码以及相关项目。

介绍

具体内容可以访问我的github（hch-xmu），本人最近也在开始做零样本领域的研究，国内进行相关的研究我发现尚且不多，尤其是应用方面的，当然本人菜鸡一个，如果有志同道合的道友，欢迎来骚扰。

https://github.com/hch-xmu/awesome-zero-shot-learning

原作者访问网站也放下面了

https://github.com/sbharadwajj/awesome-zero-shot-learning

Table of Contents

• Papers
• Datasets
• Starter code for ZSL
• Other Resources

Zero-Shot Object Classification

Papers

CVPR 2021

• Liu Bo, Qiulei Dong and Zhanyi Hu. “Hardness Sampling for Self-Training Based Transductive Zero-Shot Learning” [pdf]
• Zongyan Han, Zhenyong Fu, Shuo Chen and Jian Yang “Contrastive Embedding for Generalized Zero-Shot Learning” [pdf] [code]
• Yang Liu, Lei Zhou, Xiao Bai, Yifei Huang, Lin Gu, Jun Zhou, Tatsuya Harada. “Goal-Oriented Gaze Estimation for Zero-Shot Learning” [pdf] [code]
• “Learning Graph Embeddings for Compositional Zero-shot Learning” [pdf] [code]

ICLR 2021

• Lu Liu, Tianyi Zhou, Guodong Long, Jing Jiang, Xuanyi Dong, Chengqi Zhang. “Isometric Propagation Network for Generalized Zero-Shot Learning.” [pdf]

ECCV 2020

• TF-vaegan: Sanath Narayan^* , Akshita Gupta^* , Fahad Shahbaz Khan, Cees G. M. Snoek, Ling Shao. “Latent Embedding Feedback and Discriminative Features for Zero-Shot Classification.” ECCV (2020). [pdf] [code].
• LsrGAN: Maunil R Vyas, Hemanth Venkateswara, and Sethuraman Panchanathan. “Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learning.” ECCV (2020). [pdf].
• Xingyu Chen, Xuguang Lan, Fuchun Sun, and Nanning Zheng. “A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learning.” ECCV (2020). [pdf].
• "Region Graph Embedding Network for Zero-Shot Learning. " ECCV SPOTLIGHT(2020). [pdf].

ICLR 2020

• Tristan Sylvain, Linda Petrini, Devon Hjelm. “Locality and Compositionality in Zero-Shot Learning.” ICLR (2020). [pdf].

NeurIPS 2019

• VSC: Ziyu Wan, Dongdong Chen, Yan Li, Xingguang Yan, Junge Zhang, Yizhou Yu, Jing Liao. “Transductive Zero-Shot Learning with Visual Structure Constraint.” NeurIPS (2019). [pdf] [code].
• Hyeonwoo Yu, Beomhee Lee. “Zero-shot Learning via Simultaneous Generating and Learning.” NeurIPS (2019). [pdf].
• Jian Ni, Shanghang Zhang, Haiyong Xie. “Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning.” NeurIPS (2019). [pdf].
• SGMA: Yizhe Zhu, Jianwen Xie, Zhiqiang Tang, Xi Peng, Ahmed Elgammal. NeurIPS (2019). [pdf]

ICCV 2019

• CIZSL: Mohamed Elhoseiny, Mohamed Elfeki. “Creativity Inspired Zero-Shot Learning.” ICCV (2019). [pdf] [code]
• LFGAA+SA: Yang Liu, Jishun Guo, Deng Cai, Xiaofei He. “Attribute Attention for Semantic Disambiguation in Zero-Shot Learning.” ICCV (2019). [pdf] [code]
• TCN: Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen. “Transferable Contrastive Network for Generalized Zero-Shot Learning.” ICCV (2019). [pdf]
• GXE: Kai Li, Martin Renqiang Min, Yun Fu. “Rethinking Zero-Shot Learning: A Conditional Visual Classification Perspective.” ICCV (2019). [pdf]
• Yizhe Zhu1, Jianwen Xie, Bingchen Liu, Ahmed Elgammal. “Learning Feature-to-Feature Translator by Alternating Back-Propagation for Generative Zero-Shot Learning.” ICCV (2019). [pdf] [code]
• Yannick Le Cacheux, Herve Le Borgne, Michel Crucianu “Modeling Inter and Intra-Class Relations in the Triplet Loss for Zero-Shot Learning.” ICCV (2019). [pdf]

CVPR 2019

• CADA-VAE: Edgar Schönfeld, Sayna Ebrahimi, Samarth Sinha, Trevor Darrell, Zeynep Akata. “Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders.” CVPR (2019). [pdf] [code]
• GDAN: He Huang, Changhu Wang, Philip S. Yu, Chang-Dong Wang. “Generative Dual Adversarial Network for Generalized Zero-shot Learning.” CVPR (2019). [pdf] [code]
• DeML: Binghui Chen, Weihong Deng. “Hybrid-Attention based Decoupled Metric Learning for Zero-Shot Image Retrieval.” CVPR (2019). [pdf] [code]
• Gzsl-VSE: Pengkai Zhu, Hanxiao Wang, Venkatesh Saligrama. “Generalized Zero-Shot Recognition based on Visually Semantic Embedding.” CVPR (2019). [pdf]
• LisGAN: Jingjing Li, Mengmeng Jin, Ke Lu, Zhengming Ding, Lei Zhu, Zi Huang. “Leveraging the Invariant Side of Generative Zero-Shot Learning.” CVPR (2019). [pdf] [code]
• DGP: Michael Kampffmeyer, Yinbo Chen, Xiaodan Liang, Hao Wang, Yujia Zhang, Eric P. Xing. “Rethinking Knowledge Graph Propagation for Zero-Shot Learning.” CVPR (2019). [pdf] [code]
• DAZL: Yuval Atzmon, Gal Chechik. “Domain-Aware Generalized Zero-Shot Learning.” CVPR (2019). [pdf]
• PrEN: Meng Ye, Yuhong Guo. “Progressive Ensemble Networks for Zero-Shot Recognition.” CVPR (2019). [pdf]
• Tristan Hascoet, Yasuo Ariki, Tetsuya Takiguchi. “On Zero-Shot Learning of generic objects.” CVPR (2019). [pdf] [code]
• SABR-T: Akanksha Paul, Naraynan C Krishnan, Prateek Munjal. “Semantically Aligned Bias Reducing Zero Shot Learning.” CVPR (2019). [pdf]
• AREN: Guo-Sen Xie, Li Liu, Xiaobo Jin, Fan Zhu, Zheng Zhang, Jie Qin, Yazhou Yao, Ling Shao. “Attentive Region Embedding Network for Zero-shot Learning.” CVPR (2019). [pdf] [code]
• Zhengming Ding, Hongfu Liu. “Marginalized Latent Semantic Encoder for Zero-Shot Learning.” CVPR (2019). [pdf]
• PQZSL: Jin Li, Xuguang Lan, Yang Liu, Le Wang, Nanning Zheng. “Compressing Unknown Classes with Product Quantizer for Efficient Zero-Shot Classification.” CVPR (2019). [pdf]
• Mert Bulent Sariyildiz, Ramazan Gokberk Cinbis. “Gradient Matching Generative Networks for Zero-Shot Learning.” CVPR (2019). [pdf]
• Bin Tong, Chao Wang, Martin Klinkigt, Yoshiyuki Kobayashi, Yuuichi Nonaka. “Hierarchical Disentanglement of Discriminative Latent Features for Zero-shot Learning.” CVPR (2019). [pdf]

NeurIPS 2018

• DCN: Shichen Liu, Mingsheng Long, Jianmin Wang, Michael I. Jordan.“Generalized Zero-Shot Learning with Deep Calibration Network” NeurIPS (2018). [pdf]
• S2GA: Yunlong Yu, Zhong Ji, Yanwei Fu, Jichang Guo, Yanwei Pang, Zhongfei (Mark) Zhang.“Stacked Semantics-Guided Attention Model for Fine-Grained Zero-Shot Learning.” NeurIPS (2018). [pdf]
• DIPL: An Zhao, Mingyu Ding, Jiechao Guan, Zhiwu Lu, Tao Xiang, Ji-Rong Wen “Domain-Invariant Projection Learning for Zero-Shot Recognition.” NeurIPS (2018). [pdf]

ECCV 2018

• SZSL: Jie Song, Chengchao Shen, Jie Lei, An-Xiang Zeng, Kairi Ou, Dacheng Tao, Mingli Song. “Selective Zero-Shot Classification with Augmented Attributes.” ECCV (2018). [pdf]
• LCP-SA: Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen. “Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition.” ECCV (2018). [pdf]
• MC-ZSL: Rafael Felix, Vijay Kumar B. G., Ian Reid, Gustavo Carneiro. “Multi-modal Cycle-consistent Generalized Zero-Shot Learning.” ECCV (2018). [pdf] [code]

CVPR 2018

• GCN: Xiaolong Wang, Yufei Ye, Abhinav Gupta. “Zero-shot Recognition via Semantic Embeddings and Knowledge Graphs.” CVPR (2018). [pdf] [code]
• PSR: Yashas Annadani, Soma Biswas. “Preserving Semantic Relations for Zero-Shot Learning.” CVPR (2018). [pdf]
• GAN-NT: Yizhe Zhu, Mohamed Elhoseiny, Bingchen Liu, Xi Peng, Ahmed Elgammal. “A Generative Adversarial Approach for Zero-Shot Learning From Noisy Texts.” CVPR (2018). [pdf]
• TUE: Jie Song, Chengchao Shen, Yezhou Yang, Yang Liu, Mingli Song. “Transductive Unbiased Embedding for Zero-Shot Learning.” CVPR (2018). [pdf]
• SP-AEN: Long Chen, Hanwang Zhang, Jun Xiao, Wei Liu, Shih-Fu Chang. “Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks.” CVPR (2018). [pdf] [code]
• ML-SKG: Chung-Wei Lee, Wei Fang, Chih-Kuan Yeh, Yu-Chiang Frank Wang. “Multi-Label Zero-Shot Learning With Structured Knowledge Graphs.” CVPR (2018). [pdf] [project]
• GZSL-SE: Vinay Kumar Verma, Gundeep Arora, Ashish Mishra, Piyush Rai. “Generalized Zero-Shot Learning via Synthesized Examples.” CVPR (2018). [pdf]
• FGN: Yongqin Xian, Tobias Lorenz, Bernt Schiele, Zeynep Akata. “Feature Generating Networks for Zero-Shot Learning.” CVPR (2018). [pdf] [code] [project]
• LDF: Yan Li, Junge Zhang, Jianguo Zhang, Kaiqi Huang. “Discriminative Learning of Latent Features for Zero-Shot Recognition.” CVPR (2018). [pdf]
• WSL: Li Niu, Ashok Veeraraghavan, and Ashu Sabharwal. “Webly Supervised Learning Meets Zero-shot Learning: A Hybrid Approach for Fine-grained Classification.” CVPR (2018). [pdf]

TPAMI 2018

• C-GUB: Yongqin Xian, Christoph H. Lampert, Bernt Schiele, Zeynep Akata. “Zero-shot learning-A comprehensive evaluation of the good, the bad and the ugly.” TPAMI (2018). [pdf] [project]

AAAI 2018, 2017

• GANZrl: Bin Tong, Martin Klinkigt, Junwen Chen, Xiankun Cui, Quan Kong, Tomokazu Murakami, Yoshiyuki Kobayashi. “Adversarial Zero-shot Learning With Semantic Augmentation.” AAAI (2018). [pdf]
• JDZsL: Soheil Kolouri, Mohammad Rostami, Yuri Owechko, Kyungnam Kim. “Joint Dictionaries for Zero-Shot Learning.” AAAI (2018). [pdf]
• VZSL: Wenlin Wang, Yunchen Pu, Vinay Kumar Verma, Kai Fan, Yizhe Zhang, Changyou Chen, Piyush Rai, Lawrence Carin. “Zero-Shot Learning via Class-Conditioned Deep Generative Models.” AAAI (2018). [pdf]
• AS: Yuchen Guo, Guiguang Ding, Jungong Han, Sheng Tang. “Zero-Shot Learning With Attribute Selection.” AAAI (2018). [pdf]
• DSSC: Yan Li, Zhen Jia, Junge Zhang, Kaiqi Huang, Tieniu Tan.“Deep Semantic Structural Constraints for Zero-Shot Learning.” AAAI (2018). [pdf]
• ZsRDA: Yang Long, Li Liu, Yuming Shen, Ling Shao. “Towards Affordable Semantic Searching: Zero-Shot Retrieval via Dominant Attributes.” AAAI (2018). [pdf]
• DCL: Yuchen Guo, Guiguang Ding, Jungong Han, Yue Gao. “Zero-Shot Recognition via Direct Classifier Learning with Transferred Samples and Pseudo Labels.” AAAI (2017). [pdf]

ICCV 2017

• A2C: Berkan Demirel, Ramazan Gokberk Cinbis, Nazli Ikizler-Cinbis. “Attributes2Classname: A Discriminative Model for Attribute-Based Unsupervised Zero-Shot Learning.” ICCV (2017). [pdf] [code]
• PVE: Soravit Changpinyo, Wei-Lun Chao, Fei Sha. “Predicting Visual Exemplars of Unseen Classes for Zero-Shot Learning.” ICCV (2017). [pdf][code]
• LDL: Huajie Jiang, Ruiping Wang, Shiguang Shan, Yi Yang, Xilin Chen. “Learning Discriminative Latent Attributes for Zero-Shot Classification.” ICCV (2017). [pdf]]

CVPR 2017

• Deep-SCoRe: Pedro Morgado, Nuno Vasconcelos.“Semantically Consistent Regularization for Zero-Shot Recognition.” CVPR (2017). [pdf] [code]
• DEM: Li Zhang, Tao Xiang, Shaogang Gong. “Learning a Deep Embedding Model for Zero-Shot Learning.” CVPR (2017). [pdf] [code]
• VDS: Yang Long, Li Liu, Ling Shao, Fumin Shen, Guiguang Ding, Jungong Han. “From Zero-Shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis.” CVPR (2017). [pdf]
• ESD: Zhengming Ding, Ming Shao, Yun Fu. “Low-Rank Embedded Ensemble Semantic Dictionary for Zero-Shot Learning.” CVPR (2017). [pdf]
• SAE: Elyor Kodirov, Tao Xiang, Shaogang Gong. “Semantic Autoencoder for Zero-Shot Learning.” CVPR (2017). [pdf] [code]
• DVSM: Yanan Li, Donghui Wang, Huanhang Hu, Yuetan Lin, Yueting Zhuang. “Zero-Shot Recognition Using Dual Visual-Semantic Mapping Paths”. CVPR (2017). [pdf]
• MTF-MR: Xing Xu, Fumin Shen, Yang Yang, Dongxiang Zhang, Heng Tao Shen, Jingkuan Song. “Matrix Tri-Factorization With Manifold Regularizations for Zero-Shot Learning.” CVPR (2017). [pdf]
• Nour Karessli, Zeynep Akata, Bernt Schiele, Andreas Bulling. “Gaze Embeddings for Zero-Shot Image Classification.” CVPR (2017). [pdf] [code]
• GUB: Yongqin Xian, Bernt Schiele, Zeynep Akata. “Zero-Shot learning - The Good, the Bad and the Ugly.” CVPR (2017).
  [pdf] [code]

CVPR 2016

• MC-ZSL: Zeynep Akata, Mateusz Malinowski, Mario Fritz, Bernt Schiele. “Multi-Cue Zero-Shot Learning With Strong Supervision.” CVPR (2016). [pdf] [code]
• LATEM: Yongqin Xian, Zeynep Akata, Gaurav Sharma, Quynh Nguyen, Matthias Hein, Bernt Schiele. “Latent Embeddings for Zero-Shot Classification.” CVPR (2016). [pdf][code]
• LIM: Ruizhi Qiao, Lingqiao Liu, Chunhua Shen, Anton van den Hengel. “Less Is More: Zero-Shot Learning From Online Textual Documents With Noise Suppression.” CVPR (2016). [pdf]
• SYNC: Soravit Changpinyo, Wei-Lun Chao, Boqing Gong, Fei Sha. “Synthesized Classifiers for Zero-Shot Learning.” CVPR (2016). [pdf][code]
• RML: Ziad Al-Halah, Makarand Tapaswi, Rainer Stiefelhagen. “Recovering the Missing Link: Predicting Class-Attribute Associations for Unsupervised Zero-Shot Learning.” CVPR (2016). [pdf]
• SLE: Ziming Zhang, Venkatesh Saligrama. “Zero-Shot Learning via Joint Latent Similarity Embedding.” CVPR (2016). [pdf] [code]

ECCV 2016

• Wei-Lun Chao, Soravit Changpinyo, Boqing Gong2, Fei Sha. “An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild.” ECCV (2016). [pdf]
• MTE: Xun Xu, Timothy M. Hospedales, Shaogang Gong. “Multi-Task Zero-Shot Action Recognition with Prioritised Data Augmentation.” ECCV (2016). [pdf]
• Ziming Zhang, Venkatesh Saligrama.“Zero-Shot Recognition via Structured Prediction.” ECCV (2016). [pdf]
• Maxime Bucher, Stephane Herbin, Frederic Jurie.“Improving Semantic Embedding Consistency by Metric Learning for Zero-Shot Classification.” ECCV (2016). [pdf]

AAAI 2016

• RKT: Donghui Wang, Yanan Li, Yuetan Lin, Yueting Zhuang. “Relational Knowledge Transfer for Zero-Shot Learning.” AAAI (2016). [pdf]

TPAMI 2016, 2015, 2013

• ALE: Zeynep Akata, Florent Perronnin, Zaid Harchaoui, and Cordelia Schmid. “Label-Embedding for Image Classification.” TPAMI (2016). [pdf]
• TMV: Yanwei Fu, Timothy M. Hospedales, Tao Xiang, Shaogang Gong. “Transductive Multi-view Zero-Shot Learning.” TPAMI (2015) [pdf] [code]
• DAP: Christoph H. Lampert, Hannes Nickisch and Stefan Harmeling. “Attribute-Based Classification for Zero-Shot
  Visual Object Categorization.” TPAMI (2013) [pdf]

CVPR 2015

• SJE: Zeynep Akata, Scott Reed, Daniel Walter, Honglak Lee, Bernt Schiele. “Evaluation of Output Embeddings for Fine-Grained Image Classification.” CVPR (2015). [pdf] [code]
• Zhenyong Fu, Tao Xiang, Elyor Kodirov, Shaogang Gong. “Zero-Shot Object Recognition by Semantic Manifold Distance.” CVPR (2015). [pdf]

ICCV 2015

• SSE: Ziming Zhang, Venkatesh Saligrama. “Zero-Shot Learning via Semantic Similarity Embedding.” ICCV (2015). [pdf] [code]
• LRL: Xin Li, Yuhong Guo, Dale Schuurmans.“Semi-Supervised Zero-Shot Classification with Label Representation Learning.” ICCV (2015). [pdf]
• UDA: Elyor Kodirov, Tao Xiang, Zhenyong Fu, Shaogang Gong. “Unsupervised Domain Adaptation for Zero-Shot Learning.” ICCV (2015). [pdf]
• Jimmy Lei Ba, Kevin Swersky, Sanja Fidler, Ruslan Salakhutdinov. “Predicting Deep Zero-Shot Convolutional Neural Networks using Textual Descriptions.” ICCV (2015). [pdf]

NIPS 2014, 2013, 2009

• Dinesh Jayram, Kristen Grauman.“Zero-Shot Recognition with Unreliable Attributes” NIPS (2014) [pdf]
• CMT: Richard Socher, Milind Ganjoo, Christopher D. Manning, Andrew Y. Ng. “Zero-Shot Learning Through Cross-Modal Transfer” NIPS (2013) [pdf] [code]
• DeViSE: Andrea Frome, Greg S. Corrado, Jonathon Shlens, Samy Bengio, Jeffrey Dean, Marc’Aurelio Ranzato, Tomas Mikolov.“DeViSE: A Deep Visual-Semantic Embedding Model” NIPS (2013) [pdf]
• Mark Palatucci, Dean Pomerleau, Geoffrey Hinton, Tom M. Mitchell. “Zero-Shot Learning with Semantic Output Codes” NIPS (2009) [pdf]

ECCV 2014

• TMV-BLP: Yanwei Fu, Timothy M. Hospedales, Tao Xiang, Zhenyong Fu, Shaogang Gong. “Transductive Multi-view Embedding for
  Zero-Shot Recognition and Annotation” ECCV (2014).[pdf] [code]
• Stanislaw Antol, Larry Zitnick, Devi Parikh. “Zero-Shot Learning via Visual Abstraction.” ECCV (2014). [pdf] [code] [project]

CVPR 2013

• ALE: Z.Akata, F. Perronnin, Z. Harchaoui, and C. Schmid. “Label Embedding for Attribute-Based Classification.” CVPR (2013). [pdf]

Other Papers

• EsZSL: Bernardino Romera-Paredes, Philip H. S. Torr. “An embarrassingly simple approach to zero-shot learning.” ICML (2015). [pdf] [Code]
• AEZSL: “Zero-Shot Learning via Category-Specific Visual-Semantic Mapping and Label Refinement” IEEE SPS (2018). [pdf]
• ZSGD: Tiancheng Zhao, Maxine Eskenazi. “Zero-Shot Dialog Generation with Cross-Domain Latent Actions” SIGDIAL (2018). [pdf] [code]
• Yanwei Fu, Tao Xiang, Yu-Gang Jiang, Xiangyang Xue, Leonid Sigal, Shaogang Gong “Recent Advances in Zero-shot Recognition”. IEEE Signal Processing Magazine. [pdf]
• Michael Kampffmeyer, Yinbo Chen, Xiaodan Liang, Hao Wang, Yujia Zhang, Eric P. Xing “Rethinking Knowledge Graph Propagation for Zero-Shot Learning” arXiv (2018). [pdf] [code]
• Survey: Wei Wang, Vincent W. Zheng, Han Yu, Chunyan Miao. “A Survey of Zero-Shot Learning: Settings, Methods, and Applications”. TIST (2019). [pdf]

Datasets

• LAD: Large-scale Attribute Dataset. Categories:230. [link]
• CUB: Caltech-UCSD Birds. Categories:200. [link]
• AWA2: Animals with Attributes. Categories:50. [link]
• aPY: attributes Pascal and Yahoo. Categories:32 [link]
• Flowers Dataset: There are two datasets, Categories: 17 and 102. [link]
• SUN: Scene Attributes. Categories:717. [link]
• HMDB51 : a large human motion database. Categories:51 [link]
• UCF101 : an action image recognition dataset of real action videos, collected from YouTube. Categories:101 [link]

Starter Code

This repository contains a Demo folder which has a Jupyter Notebook step-by-step code to “An embarrassingly simple approach to zero-shot learning.” ICML (2015).
This can be used as an introductory code to obtain the basic understanding of Zero-shot Learning.

Other resources

• https://medium.com/@alitech_2017/from-zero-to-hero-shaking-up-the-field-of-zero-shot-learning-c43208f71332
• https://www.analyticsindiamag.com/what-is-zero-shot-learning/
• https://medium.com/@cetinsamet/zero-shot-learning-53080995d45f
• https://amitness.com/2020/05/zero-shot-text-classification/