The Wayback Machine - https://web.archive.org/web/20201207185833/https://github.com/topics/natural-language-inference
Skip to content
#

natural-language-inference

Star

Here are 75 public repositories matching this topic...

Language: All
Filter by language
All 75 Python 50 Jupyter Notebook 11 Clojure 1 Julia 1 Scheme 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
gluon-nlp

dmlc / gluon-nlp

Star
Open

[Error Message] Improve error message in SentencepieceTokenizer when arguments are not expected.

5
preeyank5
preeyank5 commented Dec 3, 2020

Description

While using tokenizers.create with the model and vocab file for a custom corpus, the code throws an error and is not able to generate the BERT vocab file

Error Message

ValueError: Mismatch vocabulary! All special tokens specified must be control tokens in the sentencepiece vocabulary.

To Reproduce

from gluonnlp.data import tokenizers
tokenizers.create('spm', model_p

Read more
enhancement good first issue
Find more good first issues →

Improve this page

Add a description, image, and links to the natural-language-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the natural-language-inference topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.