ValueError: Couldn‘t instantiate the backend tokenizer from one of: (1) a `tokenizers` library seria

ValueError: Couldn't instantiate the backend tokenizer from one of: (1) a `tokenizers` library serialization file, (2) a slow tokenizer instance to convert or (3) an equivalent slow tokenizer class to instantiate and convert. You need to have sentencepiece installed to convert a slow tokenizer to a fast one.

使用以下代码解决该报错问题

!pip install transformers[sentencepiece]

你可能感兴趣的:(python,开发语言)