Skip to main content

llm-freellmpool

PyPI

A plugin for llm that lets you run free LLMs through freellmpool — which pools the free tiers of 16 providers (Groq, Cerebras, NVIDIA NIM, Gemini, OpenRouter, Cloudflare, …) with automatic failover. It works with zero API keys thanks to freellmpool's keyless providers.

Install

llm install llm-freellmpool

Use

llm -m freellmpool "Explain the CAP theorem in one sentence."

That's it — no key required. Pipe context in like any llm model:

cat error.log | llm -m freellmpool "What's the root cause?"

Pick a specific free provider or model with the target option:

llm -m freellmpool -o target groq "Say hi"
llm -m freellmpool -o target groq/llama-3.3-70b-versatile "Say hi"

More providers

Add provider keys as environment variables (GROQ_API_KEY, CEREBRAS_API_KEY, …) to unlock more models and higher limits. See the freellmpool docs.

License

MIT

Metadata

Release files for llm-freellmpool 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llm-freellmpool 0.1.0
File Size Uploaded Provenance
llm_freellmpool-0.1.0.tar.gz 3.0 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for llm-freellmpool 0.1.0
File Interpreter ABI Platform
llm_freellmpool-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 6.7 kB

Release files / llm_freellmpool-0.1.0.tar.gz

Download URL llm_freellmpool-0.1.0.tar.gz
Size 3.0 kB
Tags Source
SHA-256 checksum
How to use checksums
dc5e17c59cdebb9a4a42566e26165a245cf6841406e91f7547ad5fdfc9449536
BLAKE2b-256 checksum
How to use checksums
af6617b317c468e833f7db1f68402817324f2d515fec0e2b99b641bcf8593623
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release files / llm_freellmpool-0.1.0-py3-none-any.whl

Download URL llm_freellmpool-0.1.0-py3-none-any.whl
Size 3.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d9e1d191c794aea91db0d283c33bd1cce0fe5cd0e72d3b8b67942a8f3f36555b
BLAKE2b-256 checksum
How to use checksums
3e8d18d32293117316fa4207e7470431473541f26f8ab683ffa934b8d71f1917
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Security for llm-freellmpool 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page