深度学习数据集

大学公开数据集

(Stanford)69G大规模无人机(校园)图像数据集【Stanford】

http://cvgl.stanford.edu/projects/uav_data/

人脸素描数据集【CUHK】

http://mmlab.ie.cuhk.edu.hk/archive/facesketch.html

自然语言推理(文本蕴含标记)数据集【NYU】

https://www.nyu.edu/projects/bowman/multinli/

Berkeley图像分割数据集BSDS500【Berkeley】

https://www2.eecs.berkeley.edu/Research/Projects/CS/vision/grouping/resources.html

宠物图片(分割)数据集【Oxford】

http://www.robots.ox.ac.uk/~vgg/data/pets/

发布ADE20K场景感知/解析/分割/多目标识别数据集【MIT】

https://groups.csail.mit.edu/vision/datasets/ADE20K/

多模态二元行为数据集【GaTech】

http://www.cbi.gatech.edu/mmdb/

计算机视觉／图像／视频数据集

Fashion-MNIST风格服饰图像数据集【肖涵】

https://github.com/zalandoresearch/fashion-mnist

大型(50万)LOGO标志数据集

https://data.vision.ee.ethz.ch/cvl/lld/

4D扫描(60fps移动非刚性物体3D扫描)数据集【D-FAUST】

http://dfaust.is.tue.mpg.de

基于MNIST的视觉计数合成数据集Counting MNIST

http://fomoro.com/tools/counting-mnist/

YouTube MV视频数据集【Keunwoo Choi】

https://github.com/keunwoochoi/YouTube-music-video-5M

计算机视觉合成数据集/工具大列表【unrealcv】

https://github.com/unrealcv/synthetic-computer-vision

动物属性标记数据集【ChristophH. Lampert／Daniel Pucher／JohannesDostal】

http://cvml.ist.ac.at/AwA2/

日本漫画数据集Manga109

http://dl.acm.org/citation.cfm?doid=3011549.3011551

俯拍舞蹈视频数据集

http://homepages.inf.ed.ac.uk/rbf/CEILIDHDATA/

Pixiv(着色)图片数据集【Jerry Li】

https://github.com/jerryli27/pixiv_dataset

e-VDS视频数据集

https://engineering.purdue.edu/elab/eVDS/#download

Quick, Draw!简笔画涂鸦数据集

https://github.com/googlecreativelab/quickdraw-dataset

简笔画涂鸦数据集【hardmaru】

https://github.com/hardmaru/sketch-rnn-datasets

服饰人像生成模型(&Chictopia10K[HumanParsing]时尚人像解析数据集)【Christoph Lassner／Gerard Pons-Moll／Peter V. Gehler】

http://files.is.tue.mpg.de/classner/gp/

COCO像素级标注数据集

https://github.com/nightrome/cocostuff

大规模街道级图片(分割)数据集【Peter Kontschieder】

http://blog.mapillary.com/product/2017/05/03/mapillary-vistas-dataset.html

大规模日语图片描述数据集

https://github.com/STAIR-Lab-CIT/STAIR-captions

Cityscapes街景语义分割数据集（50城30类5k细标20k粗标图片及标记视频）

https://github.com/mcordts/cityscapesScripts

(街头)时尚服饰数据集(2000+标注图片)

https://github.com/bearpaw/clothing-co-parsing 

PyTorch实现的VOC2012数据集Pixel-wise目标分割【BodoKaiser】

https://github.com/bodokaiser/piwise

Twenty Billion Neurons对象复杂运动与交互视频数据集【Nikita Johnson】

https://www.re-work.co/blog/the-something-something-video-dataset 

文本／评价／问答／自然语言数据集

(20万)英文笑话数据集【TaivoPungas】

https://github.com/taivop/joke-dataset

机器学习保险行业问答开放数据集【HainWang】

https://github.com/shuzi/insuranceQA

保险行业问答(QA)数据集【Minwei Feng】

https://github.com/shuzi/insuranceQA

Stanford NLP发布新的多轮、跨域、任务导向对话数据集【Mihail Eric】

https://github.com/keunwoochoi/YouTube-music-video-5M

实体/名词语义关系标记数据集【David S. Batista】

https://github.com/davidsbatista/Annotated-Semantic-Relationships-Datasets

NLVR：自然语言基础数据集(对象分组、数量、比较及空间关系推理)

http://lic.nlp.cornell.edu/nlvr/

2.8万文章/10万问题大规模(英语考试)阅读理解数据集

https://github.com/qizhex/RACE_AR_baselines

错误拼写数据集

http://www.dcs.bbk.ac.uk/~ROGER/corpora.html

文本简化数据集

http://www.cs.pomona.edu/~dkauchak/simplification/

英语词/句/语义框架框架标注数据集FrameNet

https://framenet.icsi.berkeley.edu/fndrupal/

(又一个)自然语言处理(NLP)数据集列表【Nicolas Iderhoff】

https://github.com/niderhoff/nlp-datasets 

跨语种/多样式/多粒度文本相似性检测数据集

https://github.com/FerreroJeremy/Cross-Language-Dataset

Quora数据集：400000行潜在重复问题

http://qim.ec.quoracdn.net/quora_duplicate_questions.tsv

文本分类数据集

http://disi.unitn.it/moschitti/corpora.htm

Frames：Maluuba对话数据集

https://datasets.maluuba.com/Frames/dl

跨域(Amazon商品评论)情感数据集

http://www.cs.jhu.edu/~mdredze/datasets/sentiment/

语义网机器学习系统评价/基准数据集集合

http://dws.informatik.uni-mannheim.de/en/research/a-collection-of-benchmark-datasets-for-ml

常用人脸数据集

[1]CAS-PEAL Face Database

http://www.jdl.ac.cn/peal/index.html

[2] FaceRecognition Grand Challenge (FRGC) v2.0 

https://www.nist.gov/programs-projects/face-recognition-grand-challenge-frgc

[3] LabeledFaces in the Wild (LFW) 

http://vis-www.cs.umass.edu/lfw/

[4] CASIAWebFace Database 

http://www.cbsr.ia.ac.cn/english/CASIA-WebFace-Database.html

[5] YouTubeCelebrities Face Tracking and RecognitionDataset (YTC) 

http://seqamlab.com/youtube-celebrities-face-tracking-and-recognition-dataset/

[6] YouTubeFaces DB 

http://www.cs.tau.ac.il/~wolf/ytfaces/

[7] Honda/UCSDVideo Database 

http://www.lvc.ele.puc-rio.br/projects/video_surveillance/databases.html

[8] COXFace Database (COX) 

http://vipl.ict.ac.cn/resources/datasets/cox-face-dataset/

[9] Pointand Shoot Face Recognition Challenge (PaSC) 

https://www.nist.gov/programs-projects/point-and-shoot-face-recognition-challenge-pasc

[10] WIDER FACE 

http://mmlab.ie.cuhk.edu.hk/projects/WIDERFace/

[11] MS-Celeb-1M: Challenge of Recognizing OneMillionCelebrities in the Real World 

https://www.microsoft.com/en-us/research/project/ms-celeb-1m-challenge-recognizing-one-million-celebrities-real-world/

[12] Large-scale CelebFaces Attributes (CelebA) Dataset

http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html

人脸资源如下：

Papers

1.  DeepFace.A  work from Facebook.

https://www.cs.toronto.edu/~ranzato/publications/taigman_cvpr14.pdf

2.  FaceNet.A  work from Google.

http://www.cvfoundation.org/openaccess/content_cvpr_2015/app/1A_089.pdf

3.  One  Millisecond Face Alignment with an Ensemble ofRegression Trees.   Dlib implements the algorithm.

http://www.csc.kth.se/~vahidk/papers/KazemiCVPR14.pdf

4.  DeepID

http://mmlab.ie.cuhk.edu.hk/pdf/YiSun_CVPR14.pdf

5.  DeepID2

http://arxiv.org/abs/1406.4773

6.  DeepID3

http://arxiv.org/abs/1502.00873

7.  Learning Face Representation from Scratch

http://arxiv.org/abs/1411.7923

8.  Face Search at Scale: 80 Million Gallery

http://arxiv.org/abs/1507.07242

9.  A  Discriminative Feature Learning Approach for Deep FaceRecognition

http://ydwen.github.io/papers/WenECCV16.pdf

10.   NormFace: L2 Hypersphere  Embedding for Face Verification.*attention: model released !*

https://arxiv.org/abs/1704.06369

11.    SphereFace: Deep Hypersphere  Embedding for FaceRecognition

https://arxiv.org/abs/1704.08063

Datasets

1.  CASIA  WebFace Database. 10,575 subjects and494,414 images

http://www.cbsr.ia.ac.cn/english/CASIA-WebFace-Database.html

2.  Labeled Faces in the Wild.13,000 images and5749 subjects

http://vis-www.cs.umass.edu/lfw/

3.  Large-scale  CelebFaces Attributes (CelebA) Dataset 202,599images and 10,177 subjects. 5 landmark locations, 40 binary attributes.

http://mmlab.ie.cuhk.edu.hk/projects/

4.  MSRA-CFW.  202,792 images and 1,583 subjects.

http://research.microsoft.com/en-us/projects/msra-cfw/

5.  MegaFace Dataset 1  Million Faces for Recognition at Scale 690,572unique people

http://megaface.cs.washington.edu/

6.  FaceScrub.  A Dataset With Over 100,000 Face Images of 530 People.

http://vintage.winklerbros.net/facescrub.html

7.  FDDB.Face Detection  and Data Set Benchmark. 5k images.

http://vis-www.cs.umass.edu/fddb/

8.  AFLW.Annotated  Facial Landmarks in the Wild: A Large-scale,Real-world Database for  Facial Landmark Localization. 25k images.

https://lrs.icg.tugraz.at/research/aflw/

9.  AFW. Annotated Faces   in the Wild. ~1k images. 10.3D Mask Attack Dataset. 76500 frames of 17 persons using Kinect RGBD  with eyepositions (Sebastien Marcel)

http://www.ics.uci.edu/~xzhu/face/

10.   Audio-visual database for face  and speaker recognition.MobileBiometry MOBIO http://www.mobioproject.org/

https://www.idiap.ch/dataset/mobio

11.  BANCA face  and voice database. Univ of Surrey

http://www.ee.surrey.ac.uk/CVSSP/banca/

12.  Binghampton  Univ 3D static and dynamic facial expressiondatabase. (Lijun  Yin, Peter Gerhardstein and teammates)

http://www.cs.binghamton.edu/~lijun/Research/3DFE/3DFE_Analysis.html

13.  The BioID Face Database. BioID group

https://www.bioid.com/About/BioID-Face-Database

14.   Biwi 3D  Audiovisual Corpus of Affective Communication. 1000 high    quality, dynamic 3D scans of faces, recorded while pronouncing aset of     English sentences.

http://www.vision.ee.ethz.ch/datasets/b3dac2.en.html

15.  Cohn-Kanade AU-Coded Expression Database. 500+ expressionsequences of 100+ subjects, coded by activated Action Units (Affect AnalysisGroup, Univ. of  Pittsburgh.

http://www.pitt.edu/~emotion/ck-spread.htm

16.  CMU/MIT Frontal Faces . Training set: 2,429faces, 4,548  non-faces; Test set: 472 faces, 23,573 non-faces.

http://cbcl.mit.edu/software-datasets/FaceData2.html

17.  AT&T  Database of Faces 400 faces of 40people (10 images per     people)

http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

Trained Model

1.  openface. Face recognition with Google's FaceNet deep neural network usingTorch.

https://github.com/cmusatyalab/openface

2.  VGG-Face.VGG-Face CNN descriptor. Impressed embedding loss.

http://www.robots.ox.ac.uk/~vgg/software/vgg_face/

3.  SeetaFace  Engine. SeetaFace Engine is an open source C++face recognition  engine, which can run on CPU with no third-partydependence.

https://github.com/seetaface/SeetaFaceEngine

4.  Caffe-face - Caffe Face is developed for face recognition using deepneural networks.

https://github.com/ydwen/caffe-face

5.  Norm-Face - Norm Face, finetuned from center-face and Light-CNN

https://github.com/happynear/NormFace

Tutorial

1. Deep Learning for Face Recognition. Shiguan Shan, Xiaogang Wang, and Ming yang.

http://valse.mmcheng.net/deep-learning-for-face-recognition/

Software

1.  OpenCV. With some trained face  detector models.

http://opencv.org/

2.  dlib. Dlib implements  a state-of-the-art of face Alignmentalgorithm.

http://dlib.net/ml.html

3.  ccv. With a  state-of-the-art frontal face detector

https://github.com/liuliu/ccv

4.  libfacedetection.  A binary library for face detection in images.

https://github.com/ShiqiYu/libfacedetection

5.  SeetaFaceEngine. An open source C++ face recognition engine.

https://github.com/seetaface/SeetaFaceEngine

##Frameworks

1.  Caffe

http://caffe.berkeleyvision.org/

2.  Torch7

https://github.com/torch/torch7

3.  Theano

http://deeplearning.net/software/theano/

4.  cuda-convnet

https://code.google.com/p/cuda-convnet/

5.  MXNET

https://github.com/dmlc/mxnet/

6.  Tensorflow

https://github.com/tensorflow

7.  tiny-dnn

https://github.com/tiny-dnn/tiny-dnn

8.  Keras

http://keras-cn.readthedocs.io/en/latest/

Miscellaneous

1.  faceswap Face  swapping with Python, dlib, and OpenCV

https://github.com/matthewearl/faceswap

2.  Facial  Keypoints Detection Competition onKaggle.

https://www.kaggle.com/c/facial-keypoints-detection/details/deep-learning-tutorial

3. Animplementation of Face Alignment at 3000fps via Local Binary Feature

https://github.com/freesouls/face-alignment-at-3000fps

其它数据集

数据科学/机器学习数据集汇总

https://elitedatascience.com/datasets

CORe50：连续目标识别数据集【VincenzoLomonaco&DavideMaltoni】

https://vlomonaco.github.io/core50/

(Matlab)数据集统计分布自动发现【Isabel Valera】

http://proceedings.mlr.press/v70/valera17a.html

(建筑物)损害评估数据集【tsunami】

https://github.com/faiton713/ABCDdataset

IndieWeb社交图谱数据集【IndieWeb】

http://www.indiemap.org

DeepMind开源环境/数据集/代码集合【DeepMind】

https://deepmind.com/research/open-source/

鸟叫声数据集【xeno-canto】

http://www.xeno-canto.org

Wolfram数据集仓库

https://datarepository.wolframcloud.com

大型音乐分析数据集FMA

https://github.com/mdeff/fma

(300万)Instacart在线杂货购物数据集【Jeremy Stanley】

https://tech.instacart.com/3-million-instacart-orders-open-sourced-d40d29ead6f2

用于欺诈检测的合成财务数据集【TESTIMON】

https://www.kaggle.com/ntnu-testimon/paysim1

NSynth：大规模高质量音符标记音频数据集

https://magenta.tensorflow.org/datasets/nsynth

LIBSVM格式分类/回归/多标签/字符串数据集

https://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/binary.html

笔记本电脑用logistic回归拟合100G数据集【DmitriySelivanov】

http://dsnotes.com/post/2017-02-07-large-data-feature-hashing-and-online-learning-part-2/

StackExchange近似/重复问题数据集

http://nlp.cis.unimelb.edu.au/resources/cqadupstack/

2010-2017最全KDD CUP赛题回顾及数据集

http://suo.im/2kRoQ1

食谱数据集：带有评级、营养及类别信息的超过2万种食谱【HugoDarwood】

https://www.kaggle.com/hugodarwood/epirecipes

奥斯卡数据集【Academy of Motion Picture Arts and Sciences】

https://www.kaggle.com/theacademy/academy-awards

计算医疗库：(TensorFlow)大型医疗数据集分析与机器学习建模【AkshayBhat】

https://github.com/AKSHAYUBHAT/ComputationalHealthcare

聚类数据集

https://cs.joensuu.fi/sipu/datasets/

官方开放气候数据集

https://pan.baidu.com/s/1i52Xarb

全球恐怖袭击事件数据集【START Consortium】

https://www.kaggle.com/START-UMD/gtd

七个机器学习时序数据集

https://machinelearningmastery.com/time-series-datasets-for-machine-learning/

大型众包关系数据库自然语言查询语义解析数据集(8万+查询样本)

http://t.cn/RNMr09n

赛马赔率数据集

http://t.cn/RNf0tXN

新的YELP数据集：包含470万评论和15.6万商家

http://t.cn/RNG6JYi

JMIR数据集专刊《JMIR Data》

http://t.cn/RCIhmvS

用于评价监督机器学习算法的基准数据集

https:// github.com/EpistasisLab/penn-ml-benchmarks

人口普查收入数据集分类

https:// github.com/dformoso/sklearn-classification

日文木版印刷文字识别数据集

http://t.cn/RCZPfYB

多模态二元行为数据集

http://t.cn/RCzFn1g

(TensorFlow)AudioSet音频事件数据集分类模型

GitHub: tensorflow/models/tree/master/audioset

Facebook星际争霸游戏数据集

(TorchCraft可读/365GB/6万多场次/15亿帧画面/近5亿用户操作)

http://t.cn/R9j8AUM

机器学习论文/数据集/工具集锦(日文)

http://t.cn/RKV7x2A

机器学习公司的十大数据搜集策略

http://t.cn/R54rtvd

NLP数据集加载工具集

http://t.cn/RaYwYXl

日语相似词数据集

http://t.cn/RaVFV35

大规模人本完形填空(多选阅读理解)数据集

http://t.cn/Rac2Pey

高质量免费数据集列表

http://t.cn/R6B1aqa

《数据之美》自然语言数据集/代码

http://t.cn/hBOTM4

微软数据集MS MARCO，阅读理解领域的「ImageNet」

http://t.cn/RIMqGBK

AI2科学问答数据集(多选)

http://t.cn/RI5liwJ

常用图像数据集大全

（分类，跟踪，分割，检测等）

1. 搜狗实验室数据集：

http://www.sogou.com/labs/dl/p.html

互联网图片库来自sogou图片搜索所索引的部分数据。其中收集了包括人物、动物、建筑、机械、风景、运动等类别，总数高达2,836,535张图片。对于每张图片，数据集中给出了图片的原图、缩略图、所在网页以及所在网页中的相关文本。200多G

2. http://www.imageclef.org/

IMAGECLEF致力于位图片相关领域提供一个基准（检索、分类、标注等等） Cross Language Evaluation Forum (CLEF) 。从2003年开始每年举行一次比赛.

http://staff.science.uva.nl/~xirong/index.php?n=Main.Dataset

原文连接：https://mp.weixin.qq.com/s/2MHwSh37DS1ABcdaaKKIpw