Skip to main content

Strata

Run Mixture-of-Experts models larger than your RAM — on Apple Silicon.

Strata keeps only a budget of experts resident and streams the rest from SSD, so a machine that could never hold the full model can still load and generate with it.

pip install 'amperor-strata[mlx]'

Use it in your app (3 lines)

import strata

# GLM-4.5-Air is ~60 GB on disk — load it under a 16 GB budget
model = strata.load("mlx-community/GLM-4.5-Air-4bit", target_ram_gb=16)
print(model.generate("Explain how a CPU pipeline works.", max_tokens=256))

Measured on a 128 GB M5 Max, that ~60 GB model loads and generates at a ~11.5 GB peak. model accepts a Hugging Face repo id or a local MLX directory; model.stream(...) yields tokens, and generate also takes OpenAI-style messages.

Or serve it (OpenAI-compatible)

strata serve --config strata-deployment.yaml   # http://127.0.0.1:8399/v1

Point any OpenAI SDK at base_url — no code changes.

Scope

Apple Silicon / MLX, sparse-MoE models (GLM-4.5-Air, Qwen3-MoE, Mixtral, DeepSeek-V2, OLMoE, …), single-node. Throughput is device-dependent.

License

Source-available under the Business Source License 1.1 — free for non-production use (evaluation, development, research, personal); production or commercial use requires a license until the Change Date (2030-08-04), when each release converts to Apache 2.0. Not an OSI-approved open-source license. Commercial licensing: licensing@amperor.ai.

Metadata

Release files for amperor-strata 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for amperor-strata 0.1.0
File Size Uploaded Provenance Actions
amperor_strata-0.1.0.tar.gz 48.6 kB Without provenance Details for amperor_strata-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for amperor-strata 0.1.0
File Interpreter ABI Platform Actions
amperor_strata-0.1.0-py3-none-any.whl Python 3 none any Details for amperor_strata-0.1.0-py3-none-any.whl

Total release size: 104.4 kB

Release files / amperor_strata-0.1.0.tar.gz

Download URL amperor_strata-0.1.0.tar.gz
Size 48.6 kB
Tags Source
SHA-256 checksum
How to use checksums
704cd55dcfe81d323dfffa7aa1ded40b82ae61c6427e93e1daddf7d7acba8379
BLAKE2b-256 checksum
How to use checksums
ace973fe9e8b919fb5575af5cfee974b6d935505c957d31a6fce72dd53c33c2e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Release files / amperor_strata-0.1.0-py3-none-any.whl

Download URL amperor_strata-0.1.0-py3-none-any.whl
Size 55.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8984584eafb725640779d026fdd03060bab16aa8ec5756ce58963b2675395af2
BLAKE2b-256 checksum
How to use checksums
978b085e4ccae76877b0010497aaded939b64a8add734c6a39280c4023228849
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.14

Security for amperor-strata 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page