Skip to main content

Lightweight tool for working with a team of LLMs

Project description

lite squad

Tool for working with a team of LLMs. Sometimes two, or five, heads are better than one.

Usage

Install with pip:

pip install litesquad

Use in browser:

litesquad --web 

Use at command line:

litesquad "plan such and such project"
litesquad "such and such" --quick # get a quick answer, bypassing the squad

litesquad takes a few minutes to run when not in deep think mode. There's a lot of LLM calls going on under the hood (see below).

Query is distributed to worker LLMs (gemini and sonnet direct, plus deepseek, mistral, and llama via OpenRouter). Another (grok) acts as a critic that gives feedback to the workers. They revise their response. An intermediate representation of these responses is extracted to pull the content and clustered into categories of suggestions (gpt5). A judge (opus) converts these suggestions into a final coherent answer for the user.

To run the default, you will need API keys for Gemini, OpenAI, Anthropic, and OpenRouter. One OpenRouter key reaches the whole openrouter.ai catalog (deepseek, mistral, llama, grok, qwen, ...), which is how the worker roster grows wide without a key per provider. You can store your API keys in .env.

Basic tests

To see if api keys are working (from activated env): python -m litesquad.check_keys

Check on specific models: litesquad --check

Offline test: litesquad --smoke --mock

Caveats

This provides an interface to an ensemble of LLMs to try to generate a better answer than when using a single LLM. No agentic tool-usage, such as web calls, from the LLMs. Just vanilla text processing.

With apologies to squad.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litesquad-0.0.1.tar.gz (34.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

litesquad-0.0.1-py3-none-any.whl (41.7 kB view details)

Uploaded Python 3

File details

Details for the file litesquad-0.0.1.tar.gz.

File metadata

  • Download URL: litesquad-0.0.1.tar.gz
  • Upload date:
  • Size: 34.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for litesquad-0.0.1.tar.gz
Algorithm Hash digest
SHA256 cf92292f0bdae8881f76d306d6d1c2723ea77036e993ccd0f56aa1879ae5bc09
MD5 ecbc56c549187866325674ec144010b8
BLAKE2b-256 292dd7e0a8576cbf0e2fd003806bfe9ee5bcf38d698ecc4a6994c71c4fe82059

See more details on using hashes here.

File details

Details for the file litesquad-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: litesquad-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 41.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for litesquad-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 291cffa2a0442c51d296f9f9ef877d478d9119cfd6399153ec18be8daf0401e8
MD5 fc3f6467ae87fb62caa1ffe402b09e8d
BLAKE2b-256 8ae709c817be443471e7d34b94134198dc386351e9dd4f28f0b69387974b2159

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page