Self-hosted LLM console: model registry & downloads, streaming chat, OpenAI-compatible /v1 API with on-site keys, GPU worker fleet with cross-machine RPC sharding
Project description
hugpy — run your own models, your own way. Console + API in one process: hugpy serve. Join a GPU box to the fleet: hugpy worker --central https://your-hugpy/.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hugpy-0.1.31.tar.gz
(396.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
hugpy-0.1.31-py3-none-any.whl
(471.2 kB
view details)
File details
Details for the file hugpy-0.1.31.tar.gz.
File metadata
- Download URL: hugpy-0.1.31.tar.gz
- Upload date:
- Size: 396.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
34f81e3cb2476bbfb48677208dda9c9cb5cd4e45f7c4f2892bb2285e174fbd16
|
|
| MD5 |
46835353350288f7c06065fd5d44d6a9
|
|
| BLAKE2b-256 |
7cf3909ce6934e0e454aa246ef1f5beee30654895b6895c73851a5e4de25665b
|
File details
Details for the file hugpy-0.1.31-py3-none-any.whl.
File metadata
- Download URL: hugpy-0.1.31-py3-none-any.whl
- Upload date:
- Size: 471.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.13.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e06b0d79ded315698f04f4de02fe8a6f6a8f3dbb6106a84ca2d8b0b32b08e6a7
|
|
| MD5 |
e47c5e689d541f29d13b6ba0b4836d49
|
|
| BLAKE2b-256 |
a2a4f6ac8325853e20f6db8c0a1fc38e35ee08573e0393e476981175decbe78d
|
