Skip to content
mif-rs

Model inference failed

Type URI: https://modeled-information-format.github.io/mif-rs/references/errors/inference-failure/v1 HTTP status: 500 Exit code: 1 Emitted by: mif-embed (EmbedError::Inference)

Message

Section titled “Message”
model inference failed: {0}

Cause

Section titled “Cause”

A candle tensor operation failed while running the BERT forward pass or mean-pooling/normalization during Embedder::embed.

Suggested fix

Section titled “Suggested fix”

Unspecified — this indicates an internal problem with mif-embed or the cached model files. Try clearing the model cache directory and retrying, or report it upstream if the problem persists.