An OpenAI- and Anthropic-compatible gateway connecting free model stations, cloud services and local models through one API and Web UI.
- One API for Chat Completions, Responses and Anthropic Messages.
- Account management with API keys, browser/device login, renewal and rotation.
- Model discovery with capabilities, reasoning menus and availability probes.
- Live usage with calls in flight, token and cache breakdowns, first-token latency and generation speed, hour by hour for any day, kept in a local SQLite database.
- A multilingual Web UI for channels, models, chat, usage and settings.
Quick start
Requires Python 3.10 or newer:
python -m pip install -U hoshimi
hoshimi serve
Open http://127.0.0.1:10600. The package includes the built Web UI; no frontend build is needed. If that port is busy, use the URL printed by the server.
OpenCode Zen and Kilo anonymous entry points are enabled by default, without a configuration file. Availability depends on upstream models, quota and service state. Add other provider accounts in Channels, and configure the gateway in Settings.
python -m hoshimi is equivalent to hoshimi. To locate the shared configuration:
hoshimi config path
For optional cloud dependencies, CLI options, configuration migration and source installation, see the installation guide and configuration guide.
First API call
List models and replace <model-id> with an ID from the response:
curl http://127.0.0.1:10600/v1/models
curl http://127.0.0.1:10600/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{"model":"<model-id>","messages":[{"role":"user","content":"hi"}]}'
If a model API key is configured, add Authorization: Bearer <model-api-key>
to both requests. Chat Completions streams by default; send "stream": false
for JSON.
OpenAI-compatible clients generally use http://127.0.0.1:10600/v1 as Base URL.
Anthropic-compatible agents use http://127.0.0.1:10600 and a model from the same
catalogue. See API integration
and Anthropic agents.
Access keys
Configure two independent keys in Settings:
- Tool access key protects management APIs, settings and API documentation.
- Model API key protects external
/v1/*inference requests.
Provider account credentials are configured separately in Channels. An empty gateway key disables authentication only for its own surface. For LAN access, configure the tool key and permitted client networks; see authentication.
Documentation
| Task | Guide |
|---|---|
| Install, upgrade or use the Web UI | Installation |
| Configure paths, fields or migrate an older install | Configuration |
| Set keys, sign in or use EAC | Authentication |
| Connect clients or agents | API · Anthropic |
| Add cloud or local accounts | Providers · Cloud platforms · NVIDIA |
| Understand capabilities, retries, quota or statistics | Model behavior |
| Develop, build or release | Development |
| Review migration coverage and protocol differences | Inventory · OpenCode · pi-free |
Full endpoint schemas are available at the running server's /docs and /openapi.json.
They use the tool access key when configured.
License
GNU General Public License, version 3 only (GPL-3.0-only). See LICENSE.
1 maintainer
Metadata
1 maintainer
Release files for hoshimi 0.6.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| hoshimi-0.6.9.tar.gz | 3.8 MB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| hoshimi-0.6.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 7.7 MB
Release files / hoshimi-0.6.9.tar.gz
| Download URL | hoshimi-0.6.9.tar.gz |
|---|---|
| Size | 3.8 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7f5ff99995266ac60b033195069545b68f6352a54c4cea1359f8e2d9ff4fc540
|
|
BLAKE2b-256 checksum How to use checksums |
49dc9de61afc43b6753c7b52a7c3983d1d72de135d8c2a7740b7900da5cb5800
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.17
|
Release files / hoshimi-0.6.9-py3-none-any.whl
| Download URL | hoshimi-0.6.9-py3-none-any.whl |
|---|---|
| Size | 3.9 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
74cca7ad39860236b288e62444e02c831c6e828a4f7a4ef85e1f382e00a8293e
|
|
BLAKE2b-256 checksum How to use checksums |
43a67ceced08402d4275fb30af28eec1edb781a14db873b0a29c79ee372af806
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.17
|
Security for hoshimi 0.6.9
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
