LLM:finetune预训练语言模型

RoBERTa/BERT/DistilBERT and masked language modeling

[transformers/examples/pytorch/language-modeling at main · huggingface/transformers · GitHub]

Whole word masking

[transformers/examples/pytorch/language-modeling at main · huggingface/transformers · GitHub]

[examples/research_projects/mlm_wwm]

pretrained_model = &#

你可能感兴趣的:(LLM,语言模型)