zeta-mlx-inference
MLX-based LLM inference engine with OpenAI/vLLM compatible API.
Installation
pip install zeta-mlx-inference
Features
- MLX Optimized: Native Apple Silicon performance
- OpenAI Compatible:
/v1/chat/completionsendpoint - vLLM Compatible:
/tokenize,/detokenizeendpoints - Streaming: Real-time token streaming support
- Multi-model: Support for Qwen, Llama, and more
Usage
from zeta_mlx.inference import InferenceEngine
# Create engine
engine = InferenceEngine("mlx-community/Qwen3-8B-4bit")
# Generate response
result = engine.generate(messages, params)
API Endpoints
POST /v1/chat/completions- Chat completionsPOST /tokenize- Tokenize textPOST /detokenize- Detokenize tokensGET /health- Health check
Links
1 maintainer
Metadata
1 maintainer
Release files for zeta-mlx-inference 0.3.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| zeta_mlx_inference-0.3.2.tar.gz | 15.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| zeta_mlx_inference-0.3.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 38.4 kB
Release files / zeta_mlx_inference-0.3.2.tar.gz
| Download URL | zeta_mlx_inference-0.3.2.tar.gz |
|---|---|
| Size | 15.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
31079c94979d4e917d530c29185b9be541dbed24d2a027fec792e3cb47f54250
|
|
BLAKE2b-256 checksum How to use checksums |
64e472cb66928b8c84eb3c4622b96a68336f5795d2b7d20a98ecffc5081c66e3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.14.0 Darwin/25.1.0
|
Release files / zeta_mlx_inference-0.3.2-py3-none-any.whl
| Download URL | zeta_mlx_inference-0.3.2-py3-none-any.whl |
|---|---|
| Size | 22.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1b9761885bf4bca9b9f5a1249ce2891b78cf691b295ac3e377ea878d74b99040
|
|
BLAKE2b-256 checksum How to use checksums |
bb6319024b7a2a17341aa78e3790d810d5f20290ca8c2585a1311e058ccc5868
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.14.0 Darwin/25.1.0
|
