Skip to main content

Connect your local Ollama LLMs to Tasking — real-time WebSocket relay

Project description

tt-proxy

Connect your local Ollama LLMs to Tasking — real-time streaming, no port forwarding needed.

Install

pip install tt-proxy

Usage

  1. Generate an API key at tasking.tech → Settings → AI → Local LLM → Tasking Proxy
  2. Run:
tt-proxy --key ttproxy_<your-key>
  1. Enable Local LLM in Tasking settings with endpoint http://localhost:11434
  2. Your Ollama models now appear in the Tasking model selector

Options

--key         API key (required)
--ollama-url  Ollama base URL (default: http://localhost:11434)
--port        Status server port (default: 11500)
--verbose     Debug logging

How it works

tt-proxy opens a persistent WebSocket to Tasking's relay. When you send a chat message, the cloud routes the inference request through the relay to your local Ollama instance and streams tokens back in real time.

Requirements

  • Python 3.9+
  • Ollama running locally

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tt_proxy-0.1.0.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tt_proxy-0.1.0-py3-none-any.whl (6.5 kB view details)

Uploaded Python 3

File details

Details for the file tt_proxy-0.1.0.tar.gz.

File metadata

  • Download URL: tt_proxy-0.1.0.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tt_proxy-0.1.0.tar.gz
Algorithm Hash digest
SHA256 b21aadaa78d24c1f610507ec342f596c986d2087a2904941b56014b834838b8d
MD5 d01bc19e0ee179c21686a2bfa4788b99
BLAKE2b-256 9492093966f4b27259298ab23a105b90f77bfd54d9e02eef62d579ec8c1abcbe

See more details on using hashes here.

File details

Details for the file tt_proxy-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: tt_proxy-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 6.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tt_proxy-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5e6646899c2bf161d57c0c319277cd3ef5a5569c09dc46ee34b3df4f6a093b39
MD5 1391f8e8366c6bc72817bf1d1c884c4f
BLAKE2b-256 00f7f6ce09230a46feb7838e3d09b16529025f6975779c164ba7a83cf3e3fdd0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page