Skip to main content

lmux-google

Google (Gemini) provider for lmux. Wraps the google-genai SDK, which serves Google's models through either backend:

  • Vertex AI (default) — authenticated with Google Cloud credentials
  • Gemini Developer API (AI Studio) — authenticated with an API key (vertexai=False)

Supports chat completions, streaming, and embeddings for Google-published models: Gemini and the Gemini/text embedding models.

Part of the lmux ecosystem: standardized interface, cost tracking on every response, and registry-based routing across providers.

Auth

Three authentication methods:

Application Default Credentials (default)

Uses google.auth.default(), which works with GOOGLE_APPLICATION_CREDENTIALS, gcloud CLI, or instance metadata.

from lmux_google import GoogleProvider

provider = GoogleProvider(project="my-project", location="us-central1")

Service Account

from lmux_google import GoogleServiceAccountAuthProvider

provider = GoogleProvider(
    project="my-project",
    location="us-central1",
    auth=GoogleServiceAccountAuthProvider(service_account_file="/path/to/key.json"),
)

API Key

Set GOOGLE_API_KEY in your environment:

from lmux_google import GoogleAPIKeyAuthProvider

provider = GoogleProvider(auth=GoogleAPIKeyAuthProvider(), vertexai=False)

Usage

Chat

from lmux import UserMessage

response = provider.chat("gemini-2.5-pro", [UserMessage(content="Hello")])
print(response.content)
print(response.cost)

Streaming

for chunk in provider.chat_stream("gemini-2.5-pro", [UserMessage(content="Hello")]):
    if chunk.delta:
        print(chunk.delta, end="")

Embeddings

response = provider.embed("text-embedding-005", "Hello")
print(response.embeddings)

Async

All methods have async variants: achat, achat_stream, aembed.

Registry

Use with the lmux registry to route across multiple providers:

from lmux import Registry

registry = Registry()
registry.register("google", provider)
response = registry.chat("google/gemini-2.5-pro", messages)

Provider Params

from lmux_google import GoogleParams

response = provider.chat(
    "gemini-2.5-pro",
    messages,
    provider_params=GoogleParams(thinking_config={"thinking_budget": 1024}),
)
Parameter Type Description
safety_settings list[SafetySetting] Content safety thresholds
presence_penalty float Presence penalty
frequency_penalty float Frequency penalty
seed int Deterministic sampling seed
labels dict[str, str] Request labels
thinking_config dict Thinking/reasoning configuration

Constructor Options

GoogleProvider(
    auth=...,       # AuthProvider, default: GoogleADCAuthProvider()
    project=...,    # GCP project ID
    location=...,   # GCP region
    vertexai=...,   # Use Vertex AI (default: True) vs. AI Studio
)

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lmux_google-0.8.0.tar.gz (12.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lmux_google-0.8.0-py3-none-any.whl (15.2 kB view details)

Uploaded Python 3

File details

Details for the file lmux_google-0.8.0.tar.gz.

File metadata

  • Download URL: lmux_google-0.8.0.tar.gz
  • Upload date:
  • Size: 12.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lmux_google-0.8.0.tar.gz
Algorithm Hash digest
SHA256 a9f80715da0f52a25c23dd81d644c129838fd5ba2e0e3bac141217e9659b426f
MD5 16afc62c8ddd1734ba343a414785abbd
BLAKE2b-256 8e1b1326cab6a58be174d8dd0f8b75b2ba801b104bce6b15dd34e0cfae8a4651

See more details on using hashes here.

Provenance

The following attestation bundles were made for lmux_google-0.8.0.tar.gz:

Publisher: publish.yml on cluebbehusen/lmux

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file lmux_google-0.8.0-py3-none-any.whl.

File metadata

  • Download URL: lmux_google-0.8.0-py3-none-any.whl
  • Upload date:
  • Size: 15.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for lmux_google-0.8.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ffdf86eeaadcfcb2a9485120f6dcce4706d1af29781d1cc5d02e0e6fdaf60bcd
MD5 4dfd74e8651a599ccd6df835e547ef66
BLAKE2b-256 1da36b4e825e1d133e429da66495fce381f7af2793ea2b5e7eb0d8ede935101c

See more details on using hashes here.

Provenance

The following attestation bundles were made for lmux_google-0.8.0-py3-none-any.whl:

Publisher: publish.yml on cluebbehusen/lmux

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page