Dynamo Python Bindings

Python bindings for the Dynamo runtime system, enabling distributed computing capabilities for machine learning workloads.

🚀 Quick Start

Install uv: https://docs.astral.sh/uv/#getting-started

curl -LsSf https://astral.sh/uv/install.sh | sh

Install protoc protobuf compiler: https://grpc.io/docs/protoc-installation/.

For example on an Ubuntu/Debian system:

apt install protobuf-compiler

Setup a virtualenv

uv venv
source .venv/bin/activate
uv pip install 'maturin[patchelf]'

Build and install dynamo wheel

maturin develop --uv

Run Examples

Prerequisite

See README.md.

Hello World Example

Start 3 separate shells, and activate the virtual environment in each

source .venv/bin/activate

In one shell (shell 1), run example server the instance-1

python3 ./examples/hello_world/server.py

(Optional) In another shell (shell 2), run example the server instance-2

python3 ./examples/hello_world/server.py

In the last shell (shell 3), run the example client:

python3 ./examples/hello_world/client.py

If you run the example client in rapid succession, and you started more than one server instance above, you should see the requests from the client being distributed across the server instances in each server's output. If only one server instance is started, you should see the requests go to that server each time.

Performance

The performance impacts of synchronizing the Python and Rust async runtimes is a critical consideration when optimizing the performance of a highly concurrent and parallel distributed system.

The Python GIL is a global critical section and is ultimately the death of parallelism. To compound that, when Rust async futures become ready, accessing the GIL on those async event loop needs to be considered carefully. Under high load, accessing the GIL or performing CPU intensive tasks on on the event loop threads can starve out other async tasks for CPU resources. However, performing a tokio::task::spawn_blocking is not without overheads as well.

If bouncing many small message back-and-forth between the Python and Rust event loops where Rust requires GIL access, this is pattern where moving the code from Python to Rust will give you significant gains.

Release files for ai-dynamo-runtime 1.6.0.dev20260918

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for ai-dynamo-runtime 1.6.0.dev20260918
File	Interpreter	ABI	Platform	Reset
ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_x86_64.whl 69.2 MB Sep 18, 2026	CPython 3.10	abi3	Linux glibc 2.28+ x86-64	Details
ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_aarch64.whl 68.5 MB Sep 18, 2026	CPython 3.10	abi3	Linux glibc 2.28+ ARM64	Details

Total release size: 137.7 MB

Release files / ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL	ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_x86_64.whl
Size	69.2 MB
Tags	CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum How to use checksums	`4f2dcaa921f03eb61a093683f6ba5b2e83c5300f1e24eca1a0367494e951a743`
BLAKE2b-256 checksum How to use checksums	`7eebaa1cb838e0665d9bd40db96155256636fbbc605aaec48c592005b36da6ae`
Upload date	Sep 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.14.7`

Release files / ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_aarch64.whl

Download URL	ai_dynamo_runtime-1.6.0.dev20260918-cp310-abi3-manylinux_2_28_aarch64.whl
Size	68.5 MB
Tags	CPython 3.10 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum How to use checksums	`d58fc4e08b80870c5dcecba68e863636e71f4c9ba0ee5b67c3f3706002f81a82`
BLAKE2b-256 checksum How to use checksums	`d9d8ef1338e1363e3b113e813813f4654f6529d7203a1abf07048e7de87d844a`
Upload date	Sep 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/7.0.0 CPython/3.14.7`