Skip to main content

Lightweight tool for working with a team of LLMs

Project description

lite squad

Tool for working with a team of LLMs. Sometimes two, or five, heads are better than one.

Usage

Install with pip:

pip install litesquad

Use in browser:

litesquad --web 

Use at command line:

litesquad "plan such and such project"
litesquad "such and such" --quick # get a quick answer, bypassing the squad

litesquad takes a few minutes to run when running in default (deep) mode. There's a lot of LLM calls going on under the hood.

Query is distributed to worker LLMs (gemini and sonnet direct, plus deepseek, mistral, and llama via OpenRouter). Another (grok) acts as a critic that gives feedback to the workers. They revise their response. An intermediate representation of these responses is extracted to pull the content and clustered into categories of suggestions (gpt5). A judge (opus) converts these suggestions into a final coherent answer for the user.

So. Many. APIs.

Todo: replace with openrouter API key only.

To run properly, litesquad currently needs API keys for Gemini, OpenAI, Anthropic, and OpenRouter. One OpenRouter key reaches the whole openrouter.ai catalog (deepseek, mistral, llama, grok, qwen, ...), which is how the worker roster grows wide without a key per provider. You can store your API keys in .env.

Basic tests

To see if api keys are working (from activated env): python -m litesquad.check_keys

Check on specific models: litesquad --check

Offline test: litesquad --smoke --mock

Caveats

This provides an interface to an swarm of LLMs to try to generate a better answer than when using a single LLM. No agentic tool-usage, such as web calls, from the LLMs. Just reasoning.

With apologies to squad.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

litesquad-0.0.2.tar.gz (34.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

litesquad-0.0.2-py3-none-any.whl (41.7 kB view details)

Uploaded Python 3

File details

Details for the file litesquad-0.0.2.tar.gz.

File metadata

  • Download URL: litesquad-0.0.2.tar.gz
  • Upload date:
  • Size: 34.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for litesquad-0.0.2.tar.gz
Algorithm Hash digest
SHA256 f9e698c149dab5c614e69b6e38e2024e7a6fbb860eca5753162d74c3f236ee27
MD5 a1a74cb39049535df19c476d173dc242
BLAKE2b-256 d5bfe283531cf872f28d77b51f7abd7f81f3f39bfc7969a52ce4a1b45a6d71b4

See more details on using hashes here.

File details

Details for the file litesquad-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: litesquad-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 41.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.3 {"installer":{"name":"uv","version":"0.11.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for litesquad-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 a61c883139887599103809e75cb87a2d37fe8c442cb9a62367269211067f9e7c
MD5 bbbf21de64592721413ba2470f4f7e13
BLAKE2b-256 74e38c7f66b8a0862fab3a0be6f31ba584944063655a8174aa83dc5d75f21bd0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page