Skip to main content

like itertools.batched but for calling LLM

Project description

BatchedLLM

like itertools.batched but for calling LLM

Ruff and Ty and PyTest checks

Example

Run the OpenAI speed comparison example with uv --script:

OPENAI_BASE_URL=<url or https://api.openai.com/v1> OPENAI_MODEL=<model or gpt-5-nano> OPENAI_API_KEY=sk-... uv run --script examples/openai_speed.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

batchedllm-0.2.0.tar.gz (19.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

batchedllm-0.2.0-py3-none-any.whl (4.3 kB view details)

Uploaded Python 3

File details

Details for the file batchedllm-0.2.0.tar.gz.

File metadata

  • Download URL: batchedllm-0.2.0.tar.gz
  • Upload date:
  • Size: 19.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for batchedllm-0.2.0.tar.gz
Algorithm Hash digest
SHA256 b670660b3de52475327dd482ef5b67e36bad9bd12376cc012e4152cea0c99994
MD5 5822d09a2b50a137a4c30c71395c685b
BLAKE2b-256 65eb99048d7e248b9adaece43b1799e6786742f137c2d304c7d2a8c5e96bb63e

See more details on using hashes here.

Provenance

The following attestation bundles were made for batchedllm-0.2.0.tar.gz:

Publisher: publish.yml on batchedllm/batchedllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file batchedllm-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: batchedllm-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 4.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for batchedllm-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d4408b360c9470a048b79a52d7c0f3b5784e56a26d04469c6cacc878bdecd57e
MD5 75e9abe8207f3fddb891b342f090ce1e
BLAKE2b-256 a05d29ae5e00436d2d412c9192541f8f03ba29241da67b2106706da1e9213af3

See more details on using hashes here.

Provenance

The following attestation bundles were made for batchedllm-0.2.0-py3-none-any.whl:

Publisher: publish.yml on batchedllm/batchedllm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page