Skip to main content

A tool to process large datasets using OpenAI's batch API

Project description

Batch Runner

📌 Overview

Process large datasets efficiently using OpenAI's batch API.


🚀 Installation

Install the latest release via PyPI:

pip install -U hamtaa-batch-runner

⚡ Quick Start

from pydantic import BaseModel
from texttools import BatchRunner, BatchConfig

config = BatchConfig(
    system_prompt="Extract entities from the text",
    job_name="entity_extraction",
    input_data_path="data.json",
    output_data_filename="results.json",
    model="gpt-4o-mini"
)

class Output(BaseModel):
    entities: list[str]

runner = BatchRunner(config, output_model=Output)
runner.run()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hamtaa_batch_runner-0.0.0.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hamtaa_batch_runner-0.0.0-py3-none-any.whl (9.0 kB view details)

Uploaded Python 3

File details

Details for the file hamtaa_batch_runner-0.0.0.tar.gz.

File metadata

  • Download URL: hamtaa_batch_runner-0.0.0.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.22

File hashes

Hashes for hamtaa_batch_runner-0.0.0.tar.gz
Algorithm Hash digest
SHA256 0e63e558454be9bd3bf0d475d50d04fe89903e701aae6ed74c65127048974afd
MD5 417f809160c2a20c3de6b3d50096e419
BLAKE2b-256 c06b4747a4fa6a28cb2c2ccba6efd22b4524b19dc7e0615c9ff829575d91243d

See more details on using hashes here.

File details

Details for the file hamtaa_batch_runner-0.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for hamtaa_batch_runner-0.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1b39488be930606132d5805d363bd14e2271aa9f3167117de0bc513d338dfca0
MD5 05f324631ca2ee3ea710cbe43c7e5a4e
BLAKE2b-256 2ae0448202eef93a3478682af64b93a66417116f46389ec83510fe7905ef0166

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page