Skip to main content

galet

Provider-agnostic LLM, embedding, and image generation stack.

Install

Install from PyPI:

pip install galet

Python 3.11 or newer. For Gemini chat, image and video support, install the gemini extra:

pip install "galet[gemini]"

Verify the installation:

python -c "import galet; print('galet import OK')"

To develop galet itself, clone and install from source instead — see Install from source. The runnable examples in samples/ are part of the repository, so clone it to try them.

Background

This package grew out of the LLM layer of a personal agent project. The provider behaviour, public interface, optional-SDK import fallbacks, and no-fail-on-missing-credential semantics are unchanged from that origin.

Features

  • Chat / completions — provider-agnostic create_response with temperature, tool calling, and response metadata. Providers: OpenAI, DeepSeek, Gemini, Mistral, Ollama.
  • Routing — explicit provider argument, or automatic model-name prefix routing with OpenAI fallback. Source names, model-name prefixes, class paths, and default models are declarative; provider implementations load only when selected.
  • Model catalog — inspect source/model metadata and resolve a model from a profile, required capabilities, and optional model/source preferences.
  • Tool calling — bounded tool loop; tools own name(), tool_def(), result_schema(), and execute().
  • Image generation — OpenAI (dall-e-*, gpt-image-*) and Gemini (gemini-*, imagen-*) backends behind a common interface.
  • Image description — vision-capable models describe images sent inline (base64, no upload).
  • Embeddings — OpenAI and Mistral embedding adapters.
  • Optional SDKs — imports degrade gracefully when a provider SDK is not installed; missing credentials never raise at import or call time.

Install from source

Requirements

  • Python 3.11 or newer. Check with python --version (or py --version on Windows). Install it from https://www.python.org/downloads/, from your distribution's package manager (Linux), or from the Microsoft Store (Windows).
  • pip and venv, bundled with the python.org installer. On Debian/Ubuntu install them with sudo apt install python3-venv python3-pip.
  • git, only needed to clone the source.

The openai SDK is installed automatically and also serves the DeepSeek, Mistral, and Ollama providers. The Gemini provider additionally needs the optional google-genai SDK (see below).

Get the source

git clone https://github.com/junwin/galet.git
cd galet

Linux

python3 -m venv .venv
.venv/bin/pip install --upgrade pip
.venv/bin/pip install -e .

Activate the virtual environment for an interactive shell:

source .venv/bin/activate

Windows

Run these from PowerShell. If python is not on PATH, use the py launcher (Command Prompt users can run the same commands, replacing py with python).

py -m venv .venv
.venv\Scripts\pip install --upgrade pip
.venv\Scripts\pip install -e .

Activate the virtual environment:

  • PowerShell: .venv\Scripts\Activate.ps1 — if script execution is blocked, first run Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
  • Command Prompt: .venv\Scripts\activate.bat

Optional: Gemini support

Gemini chat, image, and video support require the google-genai SDK, installed through the gemini extra:

# Linux
.venv/bin/pip install -e ".[gemini]"

# Windows
.venv\Scripts\pip install -e ".[gemini]"

Credential path (required for file-based credentials)

When you supply provider keys as files, galet reads them from one directory. Setting the GALET_CREDENTIAL_PATH environment variable is the simplest route; it holds the directory location, not the secrets:

# Linux — add to ~/.bashrc to make it persist across shells
export GALET_CREDENTIAL_PATH=/home/myname/credential
# Windows — PowerShell; persist for the current user
[Environment]::SetEnvironmentVariable("GALET_CREDENTIAL_PATH", "C:\Users\myname\credential", "User")

The directory must exist and contain the provider files listed under Credentials (for example oaicred.json). Copy the templates in samples/credentials/ to get started. Passing Settings(credential_path=...) in code also works, and overrides the environment variable.

If you use a named credential profile instead, GALET_CREDENTIAL_PATH is not needed for that profile — the profile names its own file, environment variable, or systemd credential. Without either route, galet falls back to the provider environment variables (OPENAI_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, MISTRAL_API_KEY) and never raises when no credential is found.

Verify the installation

# Linux
.venv/bin/python -c "import galet; print('galet import OK')"
.venv/bin/pip show galet

# Windows
.venv\Scripts\python -c "import galet; print('galet import OK')"
.venv\Scripts\pip show galet

Samples

Runnable examples live in samples/:

Script What it shows
samples/send_request.py Simple chat request (defaults to local Ollama)
samples/tool_handlers.py Tool-calling loop with a stubbed execute_command tool
samples/generate_image.py Image generation via OpenAI or Gemini
samples/describe_image.py Describe an image file with a vision model
samples/list_sources.py List providers and model-prefix routing

See samples/README.md for each script's full usage.

Configuration

galet needs two pieces of configuration, and both can be set with an environment variable or a command-line flag.

Credentials (API keys)

Galet owns provider credential resolution. Applications and delegated tasks should refer to a named profile rather than handle an API key.

A named profile selects exactly one source. Galet does not silently fall back to an environment variable or another file when that profile is selected.

from galet.settings import Settings

settings = Settings(
    credential_profiles={
        "openai-service": {
            "provider": "openai",
            "source": "file",
            "path": "/etc/galet/credentials/oaicred.json",
        }
    },
    credential_profile="openai-service",
)

key = settings.api_key("openai")

Supported profile sources:

Source Required field Behaviour
file path Reads the existing provider JSON credential format
environment variable Reads only that named environment variable
systemd credential Reads that file beneath CREDENTIALS_DIRECTORY

Systemd credentials may contain the existing JSON object or the raw API key:

[Service]
User=myapp
LoadCredential=openai:/etc/galet/credentials/oaicred.json
settings = Settings(
    credential_profiles={
        "openai-service": {
            "provider": "openai",
            "source": "systemd",
            "credential": "openai",
        }
    },
    credential_profile="openai-service",
)

For ordinary protected files, keep credentials outside the repository, make the directory accessible only to the service account, and make each credential file readable only by that account. The GALET_CREDENTIAL_PATH environment variable contains only a directory name and is not itself a secret.

For backward compatibility, when no named profile is selected Galet retains the original lookup order:

  1. The provider environment variable (OPENAI_API_KEY, DEEPSEEK_API_KEY, GEMINI_API_KEY, or MISTRAL_API_KEY).
  2. The provider file in credential_path or GALET_CREDENTIAL_PATH.

Credential file names and JSON keys:

Provider File Key(s) in the file
openai oaicred.json openai_api_key
deepseek deepseek_cred.json deepseek_api_key
gemini gemini_cred.json gemini_api_key, api_key
mistral mistral_cred.json mistral_api_key

Ready-to-use templates for each file live in samples/credentials/: copy them into your GALET_CREDENTIAL_PATH directory, drop the .example suffix, and replace the placeholder value.

Ollama base URL

Ollama needs no API key, but galet must know where the Ollama server is. galet resolves the address in this order:

  1. --ollama-base-url (command-line flag)
  2. OLLAMA_BASE_URL (environment variable)
  3. http://localhost:11434/v1 (default, Ollama's OpenAI-compatible endpoint)
# Default local Ollama
python samples/send_request.py --provider ollama "hi"

# Explicit URL
python samples/send_request.py --provider ollama --ollama-base-url http://localhost:11434/v1 "hi"

# Environment variable
OLLAMA_BASE_URL=http://192.168.87.40:11434/v1 python samples/send_request.py --provider ollama "hi"

Note the /v1 suffix: galet talks to Ollama's OpenAI-compatible endpoint, not the native Ollama API.

Model information and capability resolution

ProviderRegistry continues to route explicit model names to their source. Source and model metadata can be inspected without importing provider implementations, making an API call, or reading credentials. ModelCatalog adds deterministic capability-based selection.

from galet import ModelRequirements, default_model_catalog

for source in default_model_catalog.sources():
    print(source.name, source.default_model)

for model in default_model_catalog.models(source="openai"):
    print(model.name, sorted(model.profiles), sorted(model.capabilities))

resolved = default_model_catalog.resolve(
    ModelRequirements.create(
        profile="focused-development",
        required_capabilities=("tool-calling", "code-generation"),
        preferred_model="gpt-5-mini",
    )
)
print(resolved.source, resolved.model)

Model preferences are not agent identities. A caller may request a capability profile and allow Galet to select an eligible fallback. Credential lookup remains inside Galet's provider settings and is not exposed by the catalog.

Metadata

Release files for galet 0.1.24

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for galet 0.1.24
File Size Uploaded Provenance Actions
galet-0.1.24.tar.gz 64.6 kB Without provenance Details for galet-0.1.24.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for galet 0.1.24
File Interpreter ABI Platform Actions
galet-0.1.24-py3-none-any.whl Python 3 none any Details for galet-0.1.24-py3-none-any.whl

Total release size: 118.9 kB

Release files / galet-0.1.24.tar.gz

Download URL galet-0.1.24.tar.gz
Size 64.6 kB
Tags Source
SHA-256 checksum
How to use checksums
6f2e4efb33162469f0b0e63d20f1211496e71258d8e94f14668cf8dad1dfe4dc
BLAKE2b-256 checksum
How to use checksums
7b161aabea7d9392c1c52fb95857dc24305770b8ff90249f8ba4ef2b13e591fc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.16 {"installer":{"name":"uv","version":"0.12.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"12","id":"bookworm","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / galet-0.1.24-py3-none-any.whl

Download URL galet-0.1.24-py3-none-any.whl
Size 54.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f7da1dc59f963628e63ebcca884ad21f336834b57619108bc61ef29b78e3f2c5
BLAKE2b-256 checksum
How to use checksums
9f5653908505315afaa8864a08939924d9353d85d5eb698b94bbd4c6bc820df7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.16 {"installer":{"name":"uv","version":"0.12.16","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"12","id":"bookworm","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for galet 0.1.24

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page