Machine Learning Models

Deprecated in vNext: Support for loading and serving traditional machine learning (ONNX) models for inference was removed in vNext, along with the /v1/predict and /v1/models/{name}/predict prediction endpoints. See the v2.1 docs for documentation of this feature.

Spice no longer loads or serves traditional machine learning (ONNX) models. The Models component now serves large language models (LLMs) only.

For LLM configuration and usage, see Large Language Models.