Self-hosted LLM console: model registry & downloads, streaming chat, OpenAI-compatible /v1 API with on-site keys, GPU worker fleet with cross-machine RPC sharding
Project description
hugpy — run your own models, your own way. Console + API in one process: hugpy serve. Join a GPU box to the fleet: hugpy worker --central https://your-hugpy/.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hugpy-0.1.3.tar.gz
(393.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
hugpy-0.1.3-py3-none-any.whl
(469.0 kB
view details)
File details
Details for the file hugpy-0.1.3.tar.gz.
File metadata
- Download URL: hugpy-0.1.3.tar.gz
- Upload date:
- Size: 393.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3966d0ad0931c677752edd351530b80e264781157060f7cab246004fb1429c9f
|
|
| MD5 |
f802c06852cb992d769166e41a5165e3
|
|
| BLAKE2b-256 |
1fce03f3c7a1c5ba0d5c2d678b28e7d96f27dababddd6b423d13b7a63a6b573d
|
File details
Details for the file hugpy-0.1.3-py3-none-any.whl.
File metadata
- Download URL: hugpy-0.1.3-py3-none-any.whl
- Upload date:
- Size: 469.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
dcb92aca0bcb1e4351984bba064d9b80419475ebcf1cd59ab086b66120a39b63
|
|
| MD5 |
9d61df41927f8e2d3d5d5b842140a126
|
|
| BLAKE2b-256 |
6b5ecada0cfa6800e56ea693bf5bfee4739b46415be4f39720626974466ccc8d
|
