Skip to main content

Standardizing models and pipes for data pipelines

Project description

bollhav

Model definition framework that standardizes code at pipe and model level using the model and pipe abstractions

This library

  • is permissive by design
  • is designed with ✨developer experience✨ in mind

Concepts

Implementations:

Demo

demo

Examples

A self-contained mock pipeline in examples/ demonstrates the full bollhav pattern — models, pipes, tag matching, and write modes — without any database connections.

cd examples

# backfill mode
TAGS="[all]" USE_SCHEMA_SUFFIX=false BACKFILL_ENABLED=true \
  BACKFILL_SINCE=2024-01-01T00:00:00Z BACKFILL_UNTIL=2024-01-11T00:00:00Z \
  python main.py

# latest mode (resolves the most recent complete interval from the batch expression)
TAGS="[all]" USE_SCHEMA_SUFFIX=false LATEST_ENABLED=true \
  python main.py

See examples/README.md for the full setup and available options

Installation

pip install bollhav

Testing

Tests use pytest. Run the full suite:

pytest tests/

Build + publish example

git tag 1.2.3 && git push --tags

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bollhav-2.0.115.tar.gz (36.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bollhav-2.0.115-py3-none-any.whl (32.7 kB view details)

Uploaded Python 3

File details

Details for the file bollhav-2.0.115.tar.gz.

File metadata

  • Download URL: bollhav-2.0.115.tar.gz
  • Upload date:
  • Size: 36.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for bollhav-2.0.115.tar.gz
Algorithm Hash digest
SHA256 59f8226446c71937aa8946e0d0a542a13f99678d143c23fb1420285954959183
MD5 251483561b8a23c47e112cfc1e2e50ae
BLAKE2b-256 82c382ed0d0a7e0bc2d46b47f3a86732f6202334adb64c6e24098a9e40a8416d

See more details on using hashes here.

File details

Details for the file bollhav-2.0.115-py3-none-any.whl.

File metadata

  • Download URL: bollhav-2.0.115-py3-none-any.whl
  • Upload date:
  • Size: 32.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for bollhav-2.0.115-py3-none-any.whl
Algorithm Hash digest
SHA256 820f3c4f84309191715c11c97593291d01156ef64784f63bef8dc07e99c62c08
MD5 8fe618a6b3abfd64698766f86623af2f
BLAKE2b-256 8de90772c821896162ff0a5ef70f727da1277990742f7ad4e42bfa4b625318a3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page