Skip to main content

Multimodal orchestration for LLM analysis

Project description

Pollux

Multimodal orchestration for LLM APIs.

You describe what to analyze. Pollux handles source patterns, context caching, and multimodal complexity—so you don't.

Documentation · Quickstart · Cookbook

PyPI CI codecov Testing: MTMT Python License

Quick Start

import asyncio
from pollux import Config, Source, run

result = asyncio.run(
    run(
        "What are the key findings?",
        source=Source.from_text(
            "Pollux supports fan-out, fan-in, and broadcast source patterns. "
            "It also supports context caching for repeated prompts."
        ),
        config=Config(provider="gemini", model="gemini-2.5-flash-lite"),
    )
)
print(result["answers"][0])
# "The key findings are: (1) three source patterns (fan-out, fan-in,
#  broadcast) and (2) context caching for token and cost savings."

run() returns a ResultEnvelope dict — answers is a list with one entry per prompt.

To use OpenAI instead: Config(provider="openai", model="gpt-5-nano").

For a full 2-minute walkthrough (install, key setup, success checks), see the Quickstart.

Why Pollux?

  • Multimodal-first: PDFs, images, video, YouTube URLs, and arXiv papers—same API
  • Source patterns: Fan-out (one source, many prompts), fan-in (many sources, one prompt), and broadcast (many-to-many)
  • Context caching: Upload once, reuse across prompts—save tokens and money
  • Structured output: Get typed responses via Options(response_schema=YourModel)
  • Built for reliability: Async execution, automatic retries, concurrency control, and clear error messages with actionable hints

Installation

pip install pollux-ai

API Keys

Get a key from Google AI Studio or OpenAI Platform, then:

# Gemini (recommended starting point — supports context caching)
export GEMINI_API_KEY="your-key-here"

# OpenAI
export OPENAI_API_KEY="your-key-here"

Usage

Multi-Source Analysis

import asyncio

from pollux import Config, Source, run_many

async def main() -> None:
    config = Config(provider="gemini", model="gemini-2.5-flash-lite")
    sources = [
        Source.from_file("paper1.pdf"),
        Source.from_file("paper2.pdf"),
    ]
    prompts = ["Summarize the main argument.", "List key findings."]

    envelope = await run_many(prompts, sources=sources, config=config)
    for answer in envelope["answers"]:
        print(answer)

asyncio.run(main())

YouTube and arXiv Sources

from pollux import Source

lecture = Source.from_youtube("https://www.youtube.com/watch?v=dQw4w9WgXcQ")
paper = Source.from_arxiv("2301.07041")

Pass these to run() or run_many() like any other source — Pollux handles the rest.

Structured Output

import asyncio

from pydantic import BaseModel

from pollux import Config, Options, Source, run

class Summary(BaseModel):
    title: str
    key_points: list[str]
    sentiment: str

result = asyncio.run(
    run(
        "Summarize this document.",
        source=Source.from_file("report.pdf"),
        config=Config(provider="gemini", model="gemini-2.5-flash-lite"),
        options=Options(response_schema=Summary),
    )
)
parsed = result["structured"]  # Summary instance
print(parsed.key_points)

Configuration

from pollux import Config

config = Config(
    provider="gemini",
    model="gemini-2.5-flash-lite",
    enable_caching=True,  # Gemini-only in v1.0
)

See the Configuration Guide for details.

Provider Differences

Pollux does not force strict feature parity across providers in v1.0. See the capability matrix: Provider Capabilities.

Documentation

Contributing

See CONTRIBUTING and TESTING.md for guidelines.

Built during Google Summer of Code 2025 with Google DeepMind. Learn more

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pollux_ai-1.2.2.tar.gz (526.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pollux_ai-1.2.2-py3-none-any.whl (41.4 kB view details)

Uploaded Python 3

File details

Details for the file pollux_ai-1.2.2.tar.gz.

File metadata

  • Download URL: pollux_ai-1.2.2.tar.gz
  • Upload date:
  • Size: 526.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pollux_ai-1.2.2.tar.gz
Algorithm Hash digest
SHA256 3010ffcd41ae6c2f6e6ece6cacdc5d6b156c84e508de191237393ca2475df753
MD5 a63a1f078da6d871b0dc657e0e3bfa32
BLAKE2b-256 759cd24e1ac2f6f1d064f2761525e4bb7bcce141d13089556957079cafdb39a1

See more details on using hashes here.

Provenance

The following attestation bundles were made for pollux_ai-1.2.2.tar.gz:

Publisher: release.yml on seanbrar/pollux

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file pollux_ai-1.2.2-py3-none-any.whl.

File metadata

  • Download URL: pollux_ai-1.2.2-py3-none-any.whl
  • Upload date:
  • Size: 41.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for pollux_ai-1.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3a576272b8058755ec3cc0529989cd8574f9f770d1b9c1151052e4b5645edd11
MD5 3c4c77d0649dc81fef3ed0477af315f8
BLAKE2b-256 361acc9c6b7499c32e4504349240623a9f559cf29c87cbd2b1034a5c394e8461

See more details on using hashes here.

Provenance

The following attestation bundles were made for pollux_ai-1.2.2-py3-none-any.whl:

Publisher: release.yml on seanbrar/pollux

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page