A previous release had provenance metadata, but this release does not. View details.
This release is a pre-release and may not be stable for production use.
Truss
The simplest way to serve AI/ML models in production
Truss is the CLI for deploying and serving ML models on Baseten. Package your model's serving logic in Python, launch training jobs, and deploy to production—Truss handles containerization, dependency management, and GPU configuration.
Deploy models from any framework: transformers, diffusers, PyTorch, TensorFlow, vLLM, SGLang, TensorRT-LLM, and more:
- 🦙 Llama 3 (70B) · Qwen3
- 🧠 DeepSeek R1 — reasoning models
- 🎨 FLUX.1 — image generation
- 🗣 Whisper v3 — speech recognition
Get started | 100+ examples | Documentation
Why Truss?
- Write once, run anywhere: Package model code, weights, and dependencies with a model server that behaves the same in development and production.
- Fast developer loop: Iterate with live reload, skip Docker and Kubernetes configuration, and use a batteries-included serving environment.
- Support for all Python frameworks: From
transformersanddiffusersto PyTorch and TensorFlow to vLLM, SGLang, and TensorRT-LLM, Truss supports models created and served with any framework. - Production-ready: Built-in support for GPUs, secrets, caching, and autoscaling when deployed to Baseten or your own infrastructure.
Installation
Install Truss with:
pip install --upgrade truss
Quickstart
As a quick example, we'll package a text classification pipeline from the open-source transformers package.
Create a Truss
To get started, create a Truss with the following terminal command:
truss init text-classification
When prompted, give your Truss a name like Text classification.
Then, navigate to the newly created directory:
cd text-classification
Implement the model
One of the two essential files in a Truss is model/model.py. In this file, you write a Model class: an interface between the ML model that you're packaging and the model server that you're running it on.
There are two member functions that you must implement in the Model class:
load()loads the model onto the model server. It runs exactly once when the model server is spun up or patched.predict()handles model inference. It runs every time the model server is called.
Here's the complete model/model.py for the text classification model:
from transformers import pipeline
class Model:
def __init__(self, **kwargs):
self._model = None
def load(self):
self._model = pipeline("text-classification")
def predict(self, model_input):
return self._model(model_input)
Add model dependencies
The other essential file in a Truss is config.yaml, which configures the model serving environment. For a complete list of the config options, see the config reference.
The pipeline model relies on Transformers and PyTorch. These dependencies must be specified in the Truss config.
In config.yaml, find the line requirements. Replace the empty list with:
requirements:
- torch==2.0.1
- transformers==4.30.0
No other configuration is needed.
Deployment
Truss is maintained by Baseten and deploys to the Baseten Inference Stack, which combines optimized inference runtimes with production infrastructure for autoscaling, multi-cloud reliability, and fast cold starts.
Get an API key
To set up the Baseten remote, you'll need a Baseten API key. If you don't have a Baseten account, no worries, just sign up for an account and you'll be issued plenty of free credits to get you started.
Run truss push
With your Baseten API key ready to paste when prompted, you can deploy your model:
truss push
You can monitor your model deployment from your model dashboard on Baseten.
Invoke the model
After the model has finished deploying, you can invoke it from the terminal.
Invocation
truss predict -d '"Truss is awesome!"'
Response
[
{
"label": "POSITIVE",
"score": 0.999873161315918
}
]
Truss contributors
We enthusiastically welcome contributions in accordance with our contributors' guide and code of conduct.
7 maintainers
Metadata
7 maintainers
Release files for truss 0.14.3rc500
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Loss of provenance
These files do not have provenance metadata, despite files in a prior release including this data.
We recommend further investigation before installing these files. View details.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| truss-0.14.3rc500.tar.gz | 471.0 kB | Without provenance | Details for truss-0.14.3rc500.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| truss-0.14.3rc500-py3-none-any.whl | Python 3 | none | any | Details for truss-0.14.3rc500-py3-none-any.whl |
Total release size: 1.1 MB
Release files / truss-0.14.3rc500.tar.gz
Loss of provenance
This file belongs to a release without provenance metadata, despite a prior release including this data.
We recommend further investigation before installing this file. View details.
| Download URL | truss-0.14.3rc500.tar.gz |
|---|---|
| Size | 471.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f0ddcc4b2b6873fd995c1df5da03a80953b9e74d647572529c2700085cface07
|
|
BLAKE2b-256 checksum How to use checksums |
f1fbb843af579f4cfe75c9e1e29b122ef610070eb6259c3b427a1d1fd2ee1a1f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.7.13
|
Release files / truss-0.14.3rc500-py3-none-any.whl
Loss of provenance
This file belongs to a release without provenance metadata, despite a prior release including this data.
We recommend further investigation before installing this file. View details.
| Download URL | truss-0.14.3rc500-py3-none-any.whl |
|---|---|
| Size | 580.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
215006f486766fe21d8931b3977e3bda9067760e5a14fe3282309170d97ada99
|
|
BLAKE2b-256 checksum How to use checksums |
d8bb0ee658b6a128f997e8ec443eea7906c2581660e29a5f57b8582983d38b89
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.7.13
|
Security for truss 0.14.3rc500
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
Loss of provenance
A previous release of these files had provenance metadata, but this release does not.
While this could reflect a routine change by the project maintainers, it may also indicate that the release files have been compromised.
Release comparison
- Removed 0.14.3rc3 2 files With provenance
- Added 0.14.3rc500 2 files Without provenance
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
