Skip to main content

Connect your local Ollama LLMs to Tasking — real-time WebSocket relay

Project description

tt-proxy

Connect your local Ollama LLMs to Tasking — real-time streaming, no port forwarding needed.

Install

pip install tt-proxy

Usage

  1. Generate an API key at tasking.tech → Settings → AI → Local LLM → Tasking Proxy
  2. Run:
tt-proxy --key ttproxy_<your-key>
  1. Enable Local LLM in Tasking settings with endpoint http://localhost:11434
  2. Your Ollama models now appear in the Tasking model selector

Options

--key         API key (required)
--ollama-url  Ollama base URL (default: http://localhost:11434)
--port        Status server port (default: 11500)
--verbose     Debug logging

How it works

tt-proxy opens a persistent WebSocket to Tasking's relay. When you send a chat message, the cloud routes the inference request through the relay to your local Ollama instance and streams tokens back in real time.

Requirements

  • Python 3.9+
  • Ollama running locally

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tt_proxy-0.1.1.tar.gz (5.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tt_proxy-0.1.1-py3-none-any.whl (6.2 kB view details)

Uploaded Python 3

File details

Details for the file tt_proxy-0.1.1.tar.gz.

File metadata

  • Download URL: tt_proxy-0.1.1.tar.gz
  • Upload date:
  • Size: 5.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tt_proxy-0.1.1.tar.gz
Algorithm Hash digest
SHA256 0c59f72e123ac140188350f4ac13d3b84799f303909925f1de6e4a69001badea
MD5 806ff0c06d7bcf10f93705faecd9849c
BLAKE2b-256 d9d26f1ef24a8fd64bc58621710aa7017b0760a1459b9c1185302513b3c84e4c

See more details on using hashes here.

File details

Details for the file tt_proxy-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: tt_proxy-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 6.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.3

File hashes

Hashes for tt_proxy-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 778cd0c21be02b622870f39a8c0d33624f5da5aa4941132fd88d36a8fdc831da
MD5 2c4c406f3e3dbe607c282b047667ea6f
BLAKE2b-256 f8789aa1a53008d47ccfc4a221c5955d71e53a83df5cd985abe85c405982c613

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page