transformers Tokenizer

API

class transformers.PreTrainedTokenizer(**kwargs)

参考:
https://huggingface.co/transformers/main_classes/tokenizer.html

你可能感兴趣的:(Python,python)