lmux-groq
Groq provider for lmux. Talks to the Groq Chat Completions API directly over httpx.
Supports chat completions and streaming.
Part of the lmux ecosystem: standardized interface, cost tracking on every response, and registry-based routing across providers.
Auth
Set GROQ_API_KEY in your environment. The default GroqEnvAuthProvider reads it automatically.
from lmux_groq import GroqProvider
provider = GroqProvider()
Usage
Chat
from lmux import UserMessage
response = provider.chat("llama-3.3-70b-versatile", [UserMessage(content="Hello")])
print(response.content)
print(response.cost)
Streaming
for chunk in provider.chat_stream("llama-3.3-70b-versatile", [UserMessage(content="Hello")]):
if chunk.delta:
print(chunk.delta, end="")
Async
All methods have async variants: achat, achat_stream.
Registry
Use with the lmux registry to route across multiple providers:
from lmux import Registry
registry = Registry()
registry.register("groq", provider)
response = registry.chat("groq/llama-3.3-70b-versatile", messages)
Provider Params
from lmux_groq import GroqParams
response = provider.chat(
"llama-3.3-70b-versatile",
messages,
provider_params=GroqParams(service_tier="flex"),
)
| Parameter | Type | Description |
|---|---|---|
service_tier |
"auto" | "on_demand" | "flex" | "performance" |
Service tier selection |
seed |
int |
Deterministic sampling seed |
user |
str |
End-user identifier |
Constructor Options
GroqProvider(
auth=..., # AuthProvider[str], default: GroqEnvAuthProvider()
base_url=..., # Optional base URL override
timeout=..., # Request timeout in seconds
max_retries=..., # Max retry attempts
transport=..., # Optional httpx.BaseTransport for the sync client (proxies, testing)
async_transport=..., # Optional httpx.AsyncBaseTransport for the async client
)
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lmux_groq-0.7.0.tar.gz.
File metadata
- Download URL: lmux_groq-0.7.0.tar.gz
- Upload date:
- Size: 8.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a53509abcf45928265e015ca51b056ad2eb60c61e3c5cfc920667d599b73ae92
|
|
| MD5 |
206fe6974ee19ac5ea568a2bed1ea67a
|
|
| BLAKE2b-256 |
5cfb90c07cfc2b21ac1e8f69a60881fd51059040a5db166726bd9c18dbbfb731
|
Provenance
The following attestation bundles were made for lmux_groq-0.7.0.tar.gz:
Publisher:
publish.yml on cluebbehusen/lmux
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
lmux_groq-0.7.0.tar.gz -
Subject digest:
a53509abcf45928265e015ca51b056ad2eb60c61e3c5cfc920667d599b73ae92 - Sigstore transparency entry: 2176143725
- Sigstore integration time:
-
Permalink:
cluebbehusen/lmux@dd2f3c16589c5574fefab395d582dbb63fe9744a -
Branch / Tag:
refs/tags/lmux-groq-v0.7.0 - Owner: https://github.com/cluebbehusen
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@dd2f3c16589c5574fefab395d582dbb63fe9744a -
Trigger Event:
push
-
Statement type:
File details
Details for the file lmux_groq-0.7.0-py3-none-any.whl.
File metadata
- Download URL: lmux_groq-0.7.0-py3-none-any.whl
- Upload date:
- Size: 12.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
df1199248d774d6e442deb86beb0e4176d567802b88767e5fe543d113f2c9773
|
|
| MD5 |
2d3364d1662bef14268c300f1f988e75
|
|
| BLAKE2b-256 |
4bd7a6183b29b1ea19863c198f748a964c085b19e4eb651083dd2289eb3e39e1
|
Provenance
The following attestation bundles were made for lmux_groq-0.7.0-py3-none-any.whl:
Publisher:
publish.yml on cluebbehusen/lmux
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
lmux_groq-0.7.0-py3-none-any.whl -
Subject digest:
df1199248d774d6e442deb86beb0e4176d567802b88767e5fe543d113f2c9773 - Sigstore transparency entry: 2176143765
- Sigstore integration time:
-
Permalink:
cluebbehusen/lmux@dd2f3c16589c5574fefab395d582dbb63fe9744a -
Branch / Tag:
refs/tags/lmux-groq-v0.7.0 - Owner: https://github.com/cluebbehusen
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@dd2f3c16589c5574fefab395d582dbb63fe9744a -
Trigger Event:
push
-
Statement type:
