Skip to content

Failed to tokenize input text

Type URI: https://modeled-information-format.github.io/mif-rs/references/errors/tokenize-failure/v1 HTTP status: 422 Exit code: 2 Emitted by: mif-embed (EmbedError::Tokenize)

failed to tokenize input text: {0}

Embedder::embed’s tokenizer call failed on the supplied text — a client-input problem (e.g. malformed text), distinct from the internal model-loading failures above.

MaybeIncorrect — supply text the tokenizer can encode (valid UTF-8, non-empty).