ParaLLeM

Agents + Batch API.

Batch API support (50% discount!)
Expressive. Agents are simple Python functions.
Concise, lightweight.
Durable by default.
Built for >1 million parallel requests.

Quickstart

pip install parallem

import parallem as pllm

# Place OPENAI_API_KEY in .env file
with pllm.resume_directory(
    ".pllm/simplest",
    provider="openai",
    strategy="sync",
    dashboard=True,
    load_dotenv=True,
) as orch:
    with orch.agent() as agt:
        resp = agt.ask_llm("Please name a power of 3.")
        print(resp.final_answer)

To switch to the Batch API, simply change strategy="sync" to strategy="batch".

Responses are saved and cached. On the subsequent runs, answers are instant.

Compatibility

Sync/Batch	OpenAI	Anthropic	Google
Simple	✅	✅	✅
Structured Output	✅	✅	✅
Function Calls	✅	✅	✅
Web Search	✅	✅	✅
Image Input	✅	✅	✅
MCP	✅	✅	-

Examples

Documentation

Please refer to the documentation.

parallem.org

Metadata

Release files for parallem 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for parallem 0.0.3
File	Size	Uploaded
parallem-0.0.3.tar.gz	124.9 kB	May 19, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for parallem 0.0.3
File	Interpreter	ABI	Platform	Reset
parallem-0.0.3-py3-none-any.whl 157.9 kB May 19, 2026	Python 3	none	any	Details

Total release size: 282.8 kB

Release files / parallem-0.0.3.tar.gz

Download URL	parallem-0.0.3.tar.gz
Size	124.9 kB
Tags	Source
SHA-256 checksum How to use checksums	`59bee0feb5a2f71a8e4273efa647f5f4ee4874d2680633e6dddcc7add26922d0`
BLAKE2b-256 checksum How to use checksums	`ea2e500014a3c4743dc920c6c02cccc975fdb0cda51806b4987611c26790769c`
Upload date	May 19, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`python-requests/2.32.5`

Release files / parallem-0.0.3-py3-none-any.whl

Download URL	parallem-0.0.3-py3-none-any.whl
Size	157.9 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`b9a441d4d16cc0d2c5f29ca02acd2364183a798d5e2ff67e07f251f3c2e463e0`
BLAKE2b-256 checksum How to use checksums	`aac084d16ff3d03757f34d43e5b29da75db9985ff689c4a053a1dd010ed44a52`
Upload date	May 19, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`python-requests/2.32.5`