Skip to main content

galet

Provider-agnostic LLM, embedding, and image generation stack.

Install

Install from PyPI:

pip install galet

Python 3.11 or newer. For Gemini chat, image and video support, install the gemini extra:

pip install "galet[gemini]"

Verify the installation:

python -c "import galet; print('galet import OK')"

To develop galet itself, clone and install from source instead — see Install from source. The runnable examples in samples/ are part of the repository, so clone it to try them.

Background

This package grew out of the LLM layer of a personal agent project. The provider behaviour, public interface, optional-SDK import fallbacks, and no-fail-on-missing-credential semantics are unchanged from that origin.

Features

  • Chat / completions — provider-agnostic create_response with temperature, tool calling, and response metadata. Providers: OpenAI, DeepSeek, Gemini, Mistral, Ollama.
  • Routing — explicit provider argument, or automatic model-name prefix routing with OpenAI fallback. Source names, model-name prefixes, class paths, and default models are declarative; provider implementations load only when selected.
  • Model catalog — inspect source/model metadata and resolve a model from a profile, required capabilities, and optional model/source preferences.
  • Tool calling — bounded tool loop; tools own name(), tool_def(), result_schema(), and execute().
  • Image generation — OpenAI (dall-e-*, gpt-image-*) and Gemini (gemini-*, imagen-*) backends behind a common interface.
  • Video generation — Google Gemini Omni Flash text/image-to-video, with portrait/landscape output and MP4 download. See the video sample.
  • Image description — vision-capable models describe images sent inline (base64, no upload).
  • Embeddings — OpenAI and Mistral embedding adapters.
  • Optional SDKs — imports degrade gracefully when a provider SDK is not installed; missing credentials never raise at import or call time.

Install from source

Requirements

  • Python 3.11 or newer. Check with python --version (or py --version on Windows). Install it from https://www.python.org/downloads/, from your distribution's package manager (Linux), or from the Microsoft Store (Windows).
  • pip and venv, bundled with the python.org installer. On Debian/Ubuntu install them with sudo apt install python3-venv python3-pip.
  • git, only needed to clone the source.

The openai SDK is installed automatically and also serves the DeepSeek, Mistral, and Ollama providers. The Gemini provider additionally needs the optional google-genai SDK (see below).

Get the source

git clone https://github.com/junwin/galet.git
cd galet

Linux

python3 -m venv .venv
.venv/bin/pip install --upgrade pip
.venv/bin/pip install -e .

Activate the virtual environment for an interactive shell:

source .venv/bin/activate

Windows

Run these from PowerShell. If python is not on PATH, use the py launcher (Command Prompt users can run the same commands, replacing py with python).

py -m venv .venv
.venv\Scripts\pip install --upgrade pip
.venv\Scripts\pip install -e .

Activate the virtual environment:

  • PowerShell: .venv\Scripts\Activate.ps1 — if script execution is blocked, first run Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
  • Command Prompt: .venv\Scripts\activate.bat

Optional: Gemini support

Gemini chat, image, and video support require the google-genai SDK, installed through the gemini extra:

# Linux
.venv/bin/pip install -e ".[gemini]"

# Windows
.venv\Scripts\pip install -e ".[gemini]"

Credential path (required for file-based credentials)

When you supply provider keys as files, galet reads them from one directory. Setting the GALET_CREDENTIAL_PATH environment variable is the simplest route; it holds the directory location, not the secrets:

# Linux — add to ~/.bashrc to make it persist across shells
export GALET_CREDENTIAL_PATH=/home/myname/credential
# Windows — PowerShell; persist for the current user
[Environment]::SetEnvironmentVariable("GALET_CREDENTIAL_PATH", "C:\Users\myname\credential", "User")

The directory must exist and contain the provider files listed under Credentials (for example oaicred.json). Copy the templates in samples/credentials/ to get started. Passing Settings(credential_path=...) in code also works, and overrides the environment variable.

If you use a named credential profile instead, GALET_CREDENTIAL_PATH is not needed for that profile — the profile names its own file, environment variable, or systemd credential. Without either route, galet falls back to the provider environment variables (OPENAI_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, MISTRAL_API_KEY) and never raises when no credential is found.

Verify the installation

# Linux
.venv/bin/python -c "import galet; print('galet import OK')"
.venv/bin/pip show galet

# Windows
.venv\Scripts\python -c "import galet; print('galet import OK')"
.venv\Scripts\pip show galet

Samples

Runnable examples live in samples/:

Script What it shows
samples/send_request.py Simple chat request (defaults to local Ollama)
samples/tool_handlers.py Tool-calling loop with a stubbed execute_command tool
samples/generate_image.py Image generation via OpenAI or Gemini
samples/generate_video.py Google Omni video generation and MP4 download
samples/describe_image.py Describe an image file with a vision model
samples/list_sources.py List providers and model-prefix routing

See samples/README.md for each script's full usage.

Configuration

galet needs two pieces of configuration, and both can be set with an environment variable or a command-line flag.

Credentials (API keys)

Galet owns provider credential resolution. Applications and delegated tasks should refer to a named profile rather than handle an API key.

A named profile selects exactly one source. Galet does not silently fall back to an environment variable or another file when that profile is selected.

from galet.settings import Settings

settings = Settings(
    credential_profiles={
        "openai-service": {
            "provider": "openai",
            "source": "file",
            "path": "/etc/galet/credentials/oaicred.json",
        }
    },
    credential_profile="openai-service",
)

key = settings.api_key("openai")

Supported profile sources:

Source Required field Behaviour
file path Reads the existing provider JSON credential format
environment variable Reads only that named environment variable
systemd credential Reads that file beneath CREDENTIALS_DIRECTORY

Systemd credentials may contain the existing JSON object or the raw API key:

[Service]
User=myapp
LoadCredential=openai:/etc/galet/credentials/oaicred.json
settings = Settings(
    credential_profiles={
        "openai-service": {
            "provider": "openai",
            "source": "systemd",
            "credential": "openai",
        }
    },
    credential_profile="openai-service",
)

For ordinary protected files, keep credentials outside the repository, make the directory accessible only to the service account, and make each credential file readable only by that account. The GALET_CREDENTIAL_PATH environment variable contains only a directory name and is not itself a secret.

For backward compatibility, when no named profile is selected Galet retains the original lookup order:

  1. The provider environment variable (OPENAI_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, or MISTRAL_API_KEY).
  2. The provider file in credential_path or GALET_CREDENTIAL_PATH.

Credential file names and JSON keys:

Provider File Key(s) in the file
openai oaicred.json openai_api_key
deepseek deepseek_cred.json deepseek_api_key
gemini gemini_cred.json gemini_api_key, api_key
mistral mistral_cred.json mistral_api_key

Ready-to-use templates for each file live in samples/credentials/: copy them into your GALET_CREDENTIAL_PATH directory, drop the .example suffix, and replace the placeholder value.

Ollama base URL

Ollama needs no API key, but galet must know where the Ollama server is. galet resolves the address in this order:

  1. --ollama-base-url (command-line flag)
  2. OLLAMA_BASE_URL (environment variable)
  3. http://localhost:11434/v1 (default, Ollama's OpenAI-compatible endpoint)
# Default local Ollama
python samples/send_request.py --provider ollama "hi"

# Explicit URL
python samples/send_request.py --provider ollama --ollama-base-url http://localhost:11434/v1 "hi"

# Environment variable
OLLAMA_BASE_URL=http://192.168.87.40:11434/v1 python samples/send_request.py --provider ollama "hi"

Note the /v1 suffix: galet talks to Ollama's OpenAI-compatible endpoint, not the native Ollama API.

Model information and capability resolution

ProviderRegistry continues to route explicit model names to their source. Source and model metadata can be inspected without importing provider implementations, making an API call, or reading credentials. ModelCatalog adds deterministic capability-based selection.

from galet import ModelRequirements, default_model_catalog

for source in default_model_catalog.sources():
    print(source.name, source.default_model)

for model in default_model_catalog.models(source="openai"):
    print(model.name, sorted(model.profiles), sorted(model.capabilities))

resolved = default_model_catalog.resolve(
    ModelRequirements.create(
        profile="focused-development",
        required_capabilities=("tool-calling", "code-generation"),
        preferred_model="gpt-5-mini",
    )
)
print(resolved.source, resolved.model)

Model preferences are not agent identities. A caller may request a capability profile and allow Galet to select an eligible fallback. Credential lookup remains inside Galet's provider settings and is not exposed by the catalog.

Embedding logging

Embedding calls log through the named galet.embedding_router, galet.openai_embedding and galet.mistral_embedding loggers. Enable INFO in the host application's logging configuration to see embedding_request_start and embedding_request_done, including provider, model, input/vector counts, dimensions and timing. Direct provider calls (including galet-memory's configured provider) emit these records without requiring the router. Existing provider retry/error diagnostics use the provider's named logger as well. The router logs terminal failures at ERROR with exception type and re-raises the original exception. Summary records omit input text, vector values and credentials. Galet does not install logging handlers or change the host's global log level.

Metadata

Release files for galet 0.1.27

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for galet 0.1.27
File Size Uploaded Provenance Actions
galet-0.1.27.tar.gz 70.0 kB Without provenance Details for galet-0.1.27.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for galet 0.1.27
File Interpreter ABI Platform Actions
galet-0.1.27-py3-none-any.whl Python 3 none any Details for galet-0.1.27-py3-none-any.whl

Total release size: 127.6 kB

Release files / galet-0.1.27.tar.gz

Download URL galet-0.1.27.tar.gz
Size 70.0 kB
Tags Source
SHA-256 checksum
How to use checksums
bb806c95a04fecc895c79735c64a497fc7c39d8fd8ff6585f286bfab9b93b780
BLAKE2b-256 checksum
How to use checksums
8d7cd8ef8ec8e772ad00a66d5e8b53112cdce594b111dd52b6cb9b0f85f7dc20
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Linux Mint","version":"22.3","id":"zena","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / galet-0.1.27-py3-none-any.whl

Download URL galet-0.1.27-py3-none-any.whl
Size 57.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f82ab211aab0d50413fa685f085a6fd9300216468927020aa3473f27a67c745b
BLAKE2b-256 checksum
How to use checksums
9b92d21e59646749e4c851e13d69182c8b924a1eb6810d2f7737d0adf3cde0b0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.5 {"installer":{"name":"uv","version":"0.13.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Linux Mint","version":"22.3","id":"zena","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for galet 0.1.27

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page