kooka-server
Local inference web server for MLX / mlx-lm.
Note: mlx-lm==0.30.2 depends on transformers==5.0.0rc1, so uvx needs pre-releases enabled:
export UV_PRERELEASE=allow
Quickstart (single machine)
uvx kooka-server serve --model mlx-community/MiniMax-M2.1-4bit --host 127.0.0.1 --port 8080
Quickstart (distributed)
See docs/DISTRIBUTED_SERVER.md.
1 maintainer
Metadata
1 maintainer
Release files for kooka-server 0.0.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| kooka_server-0.0.5.tar.gz | 40.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| kooka_server-0.0.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 89.0 kB
Release files / kooka_server-0.0.5.tar.gz
| Download URL | kooka_server-0.0.5.tar.gz |
|---|---|
| Size | 40.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e76f86341abbcc7b63f44efad79dc8a1046ed3b5f54919ab3686168863f8ec13
|
|
BLAKE2b-256 checksum How to use checksums |
6d0d2c86ead6a9120829cea54b8cfde0f3d4e83e0561538ae019b59077d71713
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.24 {"installer":{"name":"uv","version":"0.9.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / kooka_server-0.0.5-py3-none-any.whl
| Download URL | kooka_server-0.0.5-py3-none-any.whl |
|---|---|
| Size | 48.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
37692bcc1afeb88650a28f015fb7870b993bd7c1b64ad6316be9d9302efbaf64
|
|
BLAKE2b-256 checksum How to use checksums |
40b11797bd7c436b841531568a437e5c9569254132ac37194f32b0ab8794c639
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.9.24 {"installer":{"name":"uv","version":"0.9.24","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
