Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

🚀 What is inference-models?

inference-models is the library to make predictions from computer vision models provided by Roboflow — designed to be fast, reliable, and user-friendly. It offers:

  • Multi-Backend Support: Run models with PyTorch, ONNX, TensorRT, or Hugging Face backends
  • Automatic Model Loading: Smart model resolution and backend selection
  • Minimal Dependencies: Composable extras system for installing only what you need
  • Behavior-Based Interfaces: Models with similar behavior share consistent APIs; custom models can define their own
  • Full Roboflow Platform Support: Run any model trained on Roboflow

Visit our documentation for more information.

🛣️ Roadmap

With release 0.19.0, we have reached the first stable release of inference-models and fully integrated the package to inference - our main inference package, making it selectable backend for running predictions from models.

We are still making changes to add new features and models. API should be fairly stable already, but the problems may still occur. If you encounter any issues, please report them.

💻 Installation

CPU installation:

uv pip install inference-models
# or with pip
pip install inference-models

inference-models can be installed with CUDA and TensorRT support - see Installation Guide for more options.

🏃‍➡️ Usage

Pretrained Models

Load and run a pretrained model:

import cv2
import supervision as sv
from inference_models import AutoModel

# Load pretrained model from Roboflow
model = AutoModel.from_pretrained("rfdetr-base")

# Run inference (works with numpy arrays or torch.Tensor)
image = cv2.imread("<path-to-your-image>")
predictions = model(image)

# Use with supervision
annotator = sv.BoxAnnotator()
annotated = annotator.annotate(image, predictions[0].to_supervision())

Your Roboflow Models

Load and run models trained on the Roboflow platform:

import cv2
import supervision as sv
from inference_models import AutoModel

# Load your custom model from Roboflow
model = AutoModel.from_pretrained(
    "<your-project>/<version>",
    api_key="<your-api-key>"  # model access secured with API key
)

# Run inference (works with numpy arrays or torch.Tensor)
image = cv2.imread("<path-to-your-image>")
predictions = model(image)

# Use with supervision
annotator = sv.BoxAnnotator()
annotated = annotator.annotate(image, predictions[0].to_supervision())

🧠 Supported Model Architectures

  • RFDetr
  • SAM models family
  • Vision-Language Models (Florence, PaliGemma, Qwen, SmolVLM, Moondream)
  • OCR (DocTR, EasyOCR, TrOCR)
  • YOLO
  • and many more

For detailed model documentation, see Supported Models.

🔧 Run your local models

Load your own model implementations from a local directory - models with architectures not in the main inference-models package. This is especially valuable for production deployment of custom models.

from inference_models import AutoModel

model = AutoModel.from_pretrained(
    "/path/to/my_custom_model",
    allow_local_code_packages=True
)

See Load Models from Local Packages for complete details on creating custom model packages.

📄 License

The inference-models package is licensed under Apache 2.0. Individual models may have different licenses - see the Supported Models for details.


Ready to get started? Head to the Quick Overview →

Metadata

Release files for inference-models 0.39.9rc2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for inference-models 0.39.9rc2
File Size Uploaded Provenance Actions
inference_models-0.39.9rc2.tar.gz 2.0 MB With provenance Details for inference_models-0.39.9rc2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for inference-models 0.39.9rc2
File Interpreter ABI Platform Actions
inference_models-0.39.9rc2-py3-none-any.whl Python 3 none any Details for inference_models-0.39.9rc2-py3-none-any.whl

Total release size: 4.3 MB

Release files / inference_models-0.39.9rc2.tar.gz

Download URL inference_models-0.39.9rc2.tar.gz
Size 2.0 MB
Tags Source
SHA-256 checksum
How to use checksums
c2dfdd248adec5a8b9972b9ef840c36fe7dd632949487439879a988e29190ed6
BLAKE2b-256 checksum
How to use checksums
729c9e141583300f16719a42f04fedd36be34e51947bb414db87f8a32d92506a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 13, 2026.

Transparency log

Release files / inference_models-0.39.9rc2-py3-none-any.whl

Download URL inference_models-0.39.9rc2-py3-none-any.whl
Size 2.3 MB
Tags Python 3
SHA-256 checksum
How to use checksums
92d7fe2081bd4010763666bced49e4feead65fcfc251e1834977a53e2635dce9
BLAKE2b-256 checksum
How to use checksums
b5d8c431a193608eee4bd4ffd3c7e3449a519ca501a6a2640a28d08be77cc1a3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 13, 2026.

Transparency log

Security for inference-models 0.39.9rc2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for inference_models-0.39.9rc2.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 13, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page