Skip to main content

A human-centred, teachable data wrangling and pipeline framework.

Project description

WowData™

PyPI version Python versions Coverage

WowData™ is a human-centred data wrangling and pipeline framework designed to make real-world data cleanup understandable, teachable, and inspectable.

Install

From PyPI:

pip install wowdata

From source (editable):

git clone https://github.com/sci2pro/wowdata.git
cd wowdata
pip install -e .

Quick Start

Create a small input CSV:

person_id,age,country
1,30,KE
2,17,UG
3,41,KE

Run with Python API:

from wowdata import Pipeline, Sink, Source, Transform

pipe = (
    Pipeline(Source("people.csv"))
    .then(Transform("cast", params={"types": {"age": "integer"}, "on_error": "null"}))
    .then(Transform("filter", params={"where": "age >= 18 and country == 'KE'"}))
    .then(Sink("adults_ke.csv"))
)

pipe.run()

Run from YAML with CLI:

wow run pipeline.yaml

Fallback command if wow conflicts in your shell:

wowdata run pipeline.yaml

Documentation

To preview docs locally:

pip install -e .[docs]
mkdocs serve

The same docs can be published to GitHub Pages (for wowdata.github.io).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wowdata-0.1.2.tar.gz (43.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wowdata-0.1.2-py3-none-any.whl (53.7 kB view details)

Uploaded Python 3

File details

Details for the file wowdata-0.1.2.tar.gz.

File metadata

  • Download URL: wowdata-0.1.2.tar.gz
  • Upload date:
  • Size: 43.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for wowdata-0.1.2.tar.gz
Algorithm Hash digest
SHA256 b85b2762c807f49bcbe00950c81c9774f55a25dffe6261d85b91527d3ec6a0ea
MD5 f35d850213a40bebfa417f48c11bcb73
BLAKE2b-256 42086f052e12132598af39a04c35f14639ea0faca42f204a300a0e269762d5e1

See more details on using hashes here.

Provenance

The following attestation bundles were made for wowdata-0.1.2.tar.gz:

Publisher: publish.yml on sci2pro/wowdata

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file wowdata-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: wowdata-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 53.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for wowdata-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 77a2d31125e2b95c03f471d33ba9227cfb9f8d4ea82278c2667d441eb07a2e8f
MD5 051c1c558c742348a2abfd67ee035bde
BLAKE2b-256 3c0f7c469a04849178de37a05198e15ec7b2f49723ef8b6d926128d654a617c3

See more details on using hashes here.

Provenance

The following attestation bundles were made for wowdata-0.1.2-py3-none-any.whl:

Publisher: publish.yml on sci2pro/wowdata

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page