Self-hosted LLM console: model registry & downloads, streaming chat, OpenAI-compatible /v1 API with on-site keys, GPU worker fleet with cross-machine RPC sharding
Project description
hugpy — run your own models, your own way. Console + API in one process: hugpy serve. Join a GPU box to the fleet: hugpy worker --central https://your-hugpy/.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hugpy-0.1.33.tar.gz
(446.5 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
hugpy-0.1.33-py3-none-any.whl
(530.9 kB
view details)
File details
Details for the file hugpy-0.1.33.tar.gz.
File metadata
- Download URL: hugpy-0.1.33.tar.gz
- Upload date:
- Size: 446.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ccec6ac6ae7cc089aae4b82ee2ca219d4407ae51cb189491ac466c0736df07e0
|
|
| MD5 |
a256599e31192082de045e06316e2c31
|
|
| BLAKE2b-256 |
3a9372fa4613082f4c9b893756ba1ea37bec23bb8a93b9b7e8f2f79740f797ba
|
File details
Details for the file hugpy-0.1.33-py3-none-any.whl.
File metadata
- Download URL: hugpy-0.1.33-py3-none-any.whl
- Upload date:
- Size: 530.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b4aaf972c7310707ab43d17ef119ce9f0b6f4a14f30ce3e7a3f616f095cd4e85
|
|
| MD5 |
ef4a8dc60a3e1276cf8061b235902e95
|
|
| BLAKE2b-256 |
3da26d33839745acbf50134155a207e5c57357f581b6c99e8a64e9d87b0d20ab
|
