“OSError: Model name './XX' was not found in tokenizers model name list” - cannot load custom tokenizer in Transformers

前端 未结 0 2092
温柔的废话
温柔的废话 2020-12-08 19:51

I\'m trying to create my own tokenizer with my own dataset/vocabulary using Sentencepiece and then use it with AlbertTokenizer transformers.

I followed really closely

相关标签:
回答
  • 消灭零回复
提交回复
热议问题