WowData™

WowData™ is a human-centred data wrangling and pipeline framework designed to make real-world data cleanup understandable, teachable, and inspectable.

Install

From PyPI:

pip install wowdata

From source (editable):

git clone https://github.com/sci2pro/wowdata.git
cd wowdata
pip install -e .

Quick Start

Create a small input CSV:

person_id,age,country
1,30,KE
2,17,UG
3,41,KE

Run with Python API:

from wowdata import Pipeline, Sink, Source, Transform

pipe = (
    Pipeline(Source("people.csv"))
    .then(Transform("cast", params={"types": {"age": "integer"}, "on_error": "null"}))
    .then(Transform("filter", params={"where": "age >= 18 and country == 'KE'"}))
    .then(Sink("adults_ke.csv"))
)

pipe.run()

Run from YAML with CLI:

wow run pipeline.yaml

Fallback command if wow conflicts in your shell:

wowdata run pipeline.yaml

Repository Examples

The repository now includes runnable sample pipelines and data files under examples/.

From the repo root, you can run them directly with --base-dir so relative CSV paths resolve correctly:

wow run examples/climate_heat_events.yaml --base-dir examples
wow run examples/climate_rainfall_alerts.yaml --base-dir examples

You can also cd examples and run the same YAML files from there.

Documentation

• Philosophy: docs/philosophy.md
• Examples: EXAMPLES.md
• Reference: REFERENCE.md
• Docs site source: docs/ + mkdocs.yml

To preview docs locally:

pip install -e .[docs]
mkdocs serve

The same docs can be published to GitHub Pages (for wowdata.github.io).

Testing

Run the default local test target:

pytest

Or through tox:

tox

tox is configured to run Python 3.14 by default. If you explicitly want a different interpreter or a wider matrix, request it directly, for example:

tox -e py311
tox -e py310,py311,py312,py313,py314