语言模型论文列表及其笔记

Language Model

  • 2017-11
    • Bengio et al. - 2003 - A neural probabilistic language model [pdf]
    • Press and Wolf - 2016 - Using the output embedding to improve language model [pdf]
  • 2019-02
    • Peters et al. - 2018- Deep contextualized word representations(ELMo) [pdf] [note]
    • Howard and Ruder - 2018 - Universal language model fine-tuning for text classification(ULMFit) [pdf]
    • Radford et al. - 2018 - Improving language understanding by generative pre-training [pdf]
    • Devlin et al. - 2018 - Bert: Pre-training of deep bidirectional transformers for language understanding [pdf]
  • references
    • Blog:The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning)
    • ELMo
      • ELMo(AllenNLP)
      • Pre-trained ELMo Representations for Many Languages
    • Quick Start: Training an IMDb sentiment model with ULMFiT
    • finetune-transformer-lm: Code and model for the paper “Improving Language Understanding by Generative Pre-Training”
    • awesome-bert: bert nlp papers, applications and github resources , BERT 相关论文和 github 项目

你可能感兴趣的:(神经网络,深度学习,自然语言处理,人工智能,自然语言处理,深度学习,神经网络,机器学习)