Skip to main content

Run a function over every row of a CSV — with progress, header validation, and structured per-row errors.

Project description

tha-csv-runner

CI

A small Python library that runs a function against every row of a CSV — with a progress bar, required header validation, and structured error capture per row.

Install

pip install tha-csv-runner

Quick start

from tha_csv_runner import ThaCSV

def process(row: dict) -> None:
    """Raise any exception to mark the row as an error. Return value is ignored."""
    if not row["email"].endswith("@example.com"):
        raise ValueError("invalid email domain")

runner = ThaCSV()

rows = runner.read("Step 1 of 1", "data.csv", ["name", "email"], process)
runner.write("Step 1 of 1", "output.csv")

How it works

  1. Opens the CSV and validates that all required_headers are present — raises immediately if any are missing
  2. Iterates every row with a tqdm progress bar labelled with desc
  3. Calls your validator(row) function — if it raises, that row is marked as an error and processing continues
  4. Appends three columns to every row: row number, row status, and message
    • On success: row status and message are blank
    • On error: row status = "error", message = str(exception)
  5. write() writes all rows (success and error) to a CSV

API

ThaCSV

ThaCSV()

runner.read()

runner.read(
    "Step 2 of 10",          # progress bar label — pass None to use the filename
    "data.csv",              # path to input CSV
    ["a", "b"],              # columns that must exist — raises ConfigError if missing
    validator=my_func,       # optional: callable(row: dict) -> None
    enrich=True,             # optional: set False to skip row number/status/message columns
)

Reads and processes all rows. Returns the rows as a list[dict] (same object as runner.rows).

When enrich=False, validator exceptions are re-raised instead of captured.

runner.write()

runner.write(
    "Step 10 of 10",                   # progress bar label — pass None to use the output filename
    output_path="output.csv",          # optional — auto-named input_processed_TIMESTAMP.csv if omitted
    sort_by="name",                    # optional — column name, or list of column names
    ascending=True,                    # optional — bool or list of bools matching sort_by
    column_order=["name", "email"],    # optional — listed columns come first, rest follow
    keep=["name", "email"],            # optional — keep only these columns (mutually exclusive with drop)
    drop=["row number"],               # optional — remove these columns (mutually exclusive with keep)
)

Returns the Path that was written.

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tha_csv_runner-0.2.2.tar.gz (32.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tha_csv_runner-0.2.2-py3-none-any.whl (5.6 kB view details)

Uploaded Python 3

File details

Details for the file tha_csv_runner-0.2.2.tar.gz.

File metadata

  • Download URL: tha_csv_runner-0.2.2.tar.gz
  • Upload date:
  • Size: 32.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tha_csv_runner-0.2.2.tar.gz
Algorithm Hash digest
SHA256 fed850a6bf08248d726a270ae27e78ce9c58eebd8a0ac606f88f0cfeb6ed6f01
MD5 b54b30187262db8a88697689c09fe520
BLAKE2b-256 681d5f4a87f7b3c91879f684f579c4cdf094f9fdfed6f21c954ed83e637fad82

See more details on using hashes here.

Provenance

The following attestation bundles were made for tha_csv_runner-0.2.2.tar.gz:

Publisher: publish.yml on tha-guy-nate/tha-csv-runner

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file tha_csv_runner-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: tha_csv_runner-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 5.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for tha_csv_runner-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 155715a45ad8b2d64dab2e5e27b1e8d49ed53e5a616ef2bf1cf87c44962b7716
MD5 5e8923965961e8a5cab22d39f40c3d30
BLAKE2b-256 edbdb16218ac77d6c5c8e2fb6bd95af91afbd05e6ad86b0d05e5fecdd6d0a184

See more details on using hashes here.

Provenance

The following attestation bundles were made for tha_csv_runner-0.2.2-py3-none-any.whl:

Publisher: publish.yml on tha-guy-nate/tha-csv-runner

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page