Skip to main content

Standardizing models and pipes for data pipelines

Project description

bollhav

Model definition framework that standardizes code at pipe and model level using the model and pipe abstractions

This library

  • is permissive by design
  • is designed with ✨developer experience✨ in mind

Concepts

Implementations:

Demo

demo

Examples

A self-contained mock pipeline in examples/ demonstrates the full bollhav pattern — models, pipes, tag matching, and write modes — without any database connections.

cd examples

# backfill mode
TAGS="[all]" USE_SCHEMA_SUFFIX=false BACKFILL_ENABLED=true \
  BACKFILL_SINCE=2024-01-01T00:00:00Z BACKFILL_UNTIL=2024-01-11T00:00:00Z \
  python main.py

# latest mode (resolves the most recent complete interval from the batch expression)
TAGS="[all]" USE_SCHEMA_SUFFIX=false LATEST_ENABLED=true \
  python main.py

See examples/README.md for the full setup and available options

Installation

pip install bollhav

Testing

Tests use pytest. Run the full suite:

pytest tests/

Build + publish example

git tag 1.2.3 && git push --tags

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bollhav-2.0.78.tar.gz (31.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bollhav-2.0.78-py3-none-any.whl (28.1 kB view details)

Uploaded Python 3

File details

Details for the file bollhav-2.0.78.tar.gz.

File metadata

  • Download URL: bollhav-2.0.78.tar.gz
  • Upload date:
  • Size: 31.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for bollhav-2.0.78.tar.gz
Algorithm Hash digest
SHA256 5dc843a26a9b049a48b0c49684488d0e63cc43b0265d9351cab1968601fe1ff7
MD5 f5d88cd79926402a444cdd8c8818afe4
BLAKE2b-256 95bde2b79a3a3e37b3fc6b9eebc568bb8bb6eca035ea3b3d2f809c6f82fae059

See more details on using hashes here.

File details

Details for the file bollhav-2.0.78-py3-none-any.whl.

File metadata

  • Download URL: bollhav-2.0.78-py3-none-any.whl
  • Upload date:
  • Size: 28.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for bollhav-2.0.78-py3-none-any.whl
Algorithm Hash digest
SHA256 b4dfdb18b402ca41b3230b20b7918f23cba2714f13366c4497147ebd4278dc76
MD5 942bf0c95c7fccc88d9efdb71c5505b3
BLAKE2b-256 ae82083e56b044e1b003355736ba286aa542c4aaa139184ec6816cc5e0947cf4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page