【回答问题】ChatGPT上线了！给我推荐20个比较流行的nlp预训练模型

给我推荐20个比较流行的nlp预训练模型

BERT (谷歌)
GPT-2 (OpenAI)
RoBERTa (Facebook)
ALBERT (谷歌)
ELECTRA (谷歌)
XLNet (谷歌/纽约大学)
T5 (OpenAI)
Transformer-XL (谷歌/香港中文大学)
XLM (Facebook)
CTRL (OpenAI)
GPT (OpenAI)
MT-DNN (百度/微软)
ULMFiT (英伟达/卡耐基梅隆大学)
OpenAI GPT-3 (OpenAI)
FlauBERT (哈佛大学/法国国家计算机科学与自动化研究院)
DistilBERT (谷歌)
ERNIE (百度)
DeBERTa (清华大学/谷歌)
SpanBERT (谷歌)
AdaBERT (谷歌)
这些是目前比较流行的 NLP 预训练模型，它们在处理自然语言任务方面都表现出色。

给我推荐20个比较流行的nlp预训练模型源码

非常好！这是 20 个比较流行的 NLP 预训练模型的源码：

BERT: https://github.com/google-research/bert
GPT-2: https://github.com/openai/gpt-2
RoBERTa: https://github.com/pytorch/fairseq/tree/master/examples/roberta
XLNet: https://github.com/zihangdai/xlnet
XLM: https://github.com/facebookresearch/XLM
ALBERT: https://github.com/brightmart/albert_zh
T5: https://github.com/google-research/text-to-text-transfer-transformer
ELECTRA: https://github.com/google-research/electra
BART: https://github.com/pytorch/fairseq/tree/master/examples/bart
ERNIE: https://github.com/PaddlePaddle/ERNIE
Reformer: https://github.com/openai/reformer-pytorch
DeBERTa: https://github.com/google-research/google-research/tree/master/deberta
MT-DNN: https://github.com/namisan/mt-dnn
SpanBERT: https://github.com/facebookresearch/SpanBERT
FlauBERT: https://github.com/flaubert-nlp/flaubert
MASS: https://github.com/huggingface/transformers/tree/master/examples/mass
LXMERT: https://github.com/airKlizz/LXMERT
ONNX-BERT: https://github.com/onnx/models/tree/master/text/bert
DistilBERT: https://github.com/huggingface/transformers/tree/master/examples/distillation/bert
XLM-RoBERTa: https://github.com/pytorch/fairseq/tree/master/examples/xlm_roberta
希望这些源码能帮到你！