This release is a pre-release and may not be stable for production use.
Dynamo Python Bindings
Python bindings for the Dynamo runtime system, enabling distributed computing capabilities for machine learning workloads.
🚀 Quick Start
- Install
uv: https://docs.astral.sh/uv/#getting-started
curl -LsSf https://astral.sh/uv/install.sh | sh
- Install
protocprotobuf compiler: https://grpc.io/docs/protoc-installation/.
For example on an Ubuntu/Debian system:
apt install protobuf-compiler
- Setup a virtualenv
uv venv
source .venv/bin/activate
uv pip install 'maturin[patchelf]'
- Build and install dynamo wheel
maturin develop --uv
Run Examples
Prerequisite
See README.md.
Hello World Example
- Start 3 separate shells, and activate the virtual environment in each
source .venv/bin/activate
- In one shell (shell 1), run example server the instance-1
python3 ./examples/hello_world/server.py
- (Optional) In another shell (shell 2), run example the server instance-2
python3 ./examples/hello_world/server.py
- In the last shell (shell 3), run the example client:
python3 ./examples/hello_world/client.py
If you run the example client in rapid succession, and you started more than one server instance above, you should see the requests from the client being distributed across the server instances in each server's output. If only one server instance is started, you should see the requests go to that server each time.
Performance
The performance impacts of synchronizing the Python and Rust async runtimes is a critical consideration when optimizing the performance of a highly concurrent and parallel distributed system.
The Python GIL is a global critical section and is ultimately the death of
parallelism. To compound that, when Rust async futures become ready,
accessing the GIL on those async event loop needs to be considered carefully.
Under high load, accessing the GIL or performing CPU intensive tasks on
on the event loop threads can starve out other async tasks for CPU resources.
However, performing a tokio::task::spawn_blocking is not without overheads
as well.
If bouncing many small message back-and-forth between the Python and Rust event loops where Rust requires GIL access, this is pattern where moving the code from Python to Rust will give you significant gains.
7 maintainers
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file ai_dynamo_runtime-1.4.0.dev20260805.tar.gz.
File metadata
- Download URL: ai_dynamo_runtime-1.4.0.dev20260805.tar.gz
- Upload date:
- Size: 5.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/7.0.0 CPython/3.14.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e74fbb0e94fcb4a785c4964ee0da773ea52baea9e6403af451943e680ca4f0c2
|
|
| MD5 |
c0b06192a92cfc61ec7a4fe2364eec61
|
|
| BLAKE2b-256 |
6e2b08765d469f6193e3d51eb825eed1033cb1be0b05e76f7d1d84e1b7a4c64d
|
