Connect your local Ollama LLMs to Tasking — real-time WebSocket relay
Project description
tt-proxy
Connect your local Ollama LLMs to Tasking — real-time streaming, no port forwarding needed.
Install
pip install tt-proxy
Usage
- Generate an API key at tasking.tech → Settings → AI → Local LLM → Tasking Proxy
- Run:
tt-proxy --key ttproxy_<your-key>
- Enable Local LLM in Tasking settings with endpoint
http://localhost:11434 - Your Ollama models now appear in the Tasking model selector
Options
--key API key (required)
--ollama-url Ollama base URL (default: http://localhost:11434)
--port Status server port (default: 11500)
--verbose Debug logging
How it works
tt-proxy opens a persistent WebSocket to Tasking's relay. When you send a chat message, the cloud routes the inference request through the relay to your local Ollama instance and streams tokens back in real time.
Requirements
- Python 3.9+
- Ollama running locally
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tt_proxy-0.1.1.tar.gz.
File metadata
- Download URL: tt_proxy-0.1.1.tar.gz
- Upload date:
- Size: 5.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0c59f72e123ac140188350f4ac13d3b84799f303909925f1de6e4a69001badea
|
|
| MD5 |
806ff0c06d7bcf10f93705faecd9849c
|
|
| BLAKE2b-256 |
d9d26f1ef24a8fd64bc58621710aa7017b0760a1459b9c1185302513b3c84e4c
|
File details
Details for the file tt_proxy-0.1.1-py3-none-any.whl.
File metadata
- Download URL: tt_proxy-0.1.1-py3-none-any.whl
- Upload date:
- Size: 6.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
778cd0c21be02b622870f39a8c0d33624f5da5aa4941132fd88d36a8fdc831da
|
|
| MD5 |
2c4c406f3e3dbe607c282b047667ea6f
|
|
| BLAKE2b-256 |
f8789aa1a53008d47ccfc4a221c5955d71e53a83df5cd985abe85c405982c613
|