aptoro 0.4.0

A minimal, functional Python ETL library for reading, validating, and transforming data using YAML schemas

Aptoro

Aptoro is a Xavante word for "preparing the arrows for hunting".

It is a minimal, functional Python ETL library for reading, validating, and transforming data using YAML schemas. Designed for simplicity and correctness, it bridges the gap between raw data files (CSV, JSON) and typed, validated Python objects.

Features

• Schema-First: Define your data model in simple, readable YAML.
• Strict Validation: Ensures data quality with type checks, constraints, and range validation.
• Rich Types: Built-in support for datetime (ISO 8601), url, file, dict, nested objects, and standard primitives.
• Multi-Format: CSV, JSON, YAML, TOML, and Markdown front-matter (Jekyll/Hugo/Obsidian style).
• Glob Patterns: Read multiple files at once with read("data/*.md").
• Functional API: Pure functions and immutable dataclasses make pipelines predictable.
• Zero Boilerplate: No complex class definitions—just load your schema and go.

Installation

pip install aptoro

CLI Usage

Aptoro provides a command-line interface for validating data files directly.

# Validate a CSV file against a schema
aptoro validate data.csv --schema schema.yaml

# Explicitly specify format
aptoro validate data.txt --schema schema.yaml --format json

Quick Start

from aptoro import load, load_schema, read, validate, to_json

# All-in-one: read + validate
entries = load(source="data.csv", schema="schema.yaml")

# Or step by step pipeline:
schema = load_schema("schema.yaml")
data = read("data.csv")
entries = validate(data, schema)

# Export to JSON
json_str = to_json(entries)

# Export with embedded metadata (self-describing files)
json_meta = to_json(entries, schema=schema, include_meta=True)

Documentation

For full details on the schema language, advanced validation, and API reference, see the Documentation.

Schema Language

Define your data schema in YAML:

name: lexicon_entry
description: Dictionary entries

fields:
  id: str
  lemma: str
  pos: str[noun|verb|adj|adv]     # Constrained values (Enum)
  definition: str
  translation: str?               # Optional field
  examples: list[str]?            # Optional list
  frequency: int = 0              # Default value
  created_at: datetime?           # Optional ISO 8601 datetime
  source_url: url?                # Optional URL

Type Syntax

• Basic types: str, int, float, bool
• Specialized types: url, file, datetime
• Optional: str?, int?, url?, datetime?
• Default value: str = "default", int = 0, list[str] = [], dict[str, int] = {}
• Constrained: str[a|b|c]
• Ranges: int[0..120], float[0.0..1.0]
• Lists: list[str], list[int]
• Dicts: dict, dict[str, int], dict[str]
• Nested objects: type: object with fields block

See DOCS.md for full syntax, including inheritance, nested structures, and front-matter reading.

Supported Formats

• CSV (auto-detects types)
• JSON
• YAML
• TOML
• Markdown front-matter (.md files with YAML front matter)

License

GNU General Public License v3 (GPLv3)