Skip to content

Failed to load the tokenizer definition

Type URI: https://modeled-information-format.github.io/mif-rs/references/errors/load-tokenizer-failure/v1 HTTP status: 500 Exit code: 1 Emitted by: mif-embed (EmbedError::LoadTokenizer)

failed to load tokenizer: {0}

tokenizers::Tokenizer::from_file (or subsequent truncation configuration) failed to load the fetched tokenizer.json definition.

Unspecified — this indicates an internal problem with mif-embed or the cached model files. Try clearing the model cache directory and retrying, or report it upstream if the problem persists.