bollhav 2.0.109

Standardizing models and pipes for data pipelines

bollhav

Model definition framework that standardizes code at pipe and model level using the model and pipe abstractions

This library

• is permissive by design
• is designed with ✨developer experience✨ in mind

Concepts

• Model
  • Upstream
• Pipe
• Tags
  • examples
• Modes
• Progress Bar

Implementations:

• Postgres
• MSSQL

Demo

Examples

A self-contained mock pipeline in examples/ demonstrates the full bollhav pattern — models, pipes, tag matching, and write modes — without any database connections.

cd examples

# backfill mode
TAGS="[all]" USE_SCHEMA_SUFFIX=false BACKFILL_ENABLED=true \
  BACKFILL_SINCE=2024-01-01T00:00:00Z BACKFILL_UNTIL=2024-01-11T00:00:00Z \
  python main.py

# latest mode (resolves the most recent complete interval from the batch expression)
TAGS="[all]" USE_SCHEMA_SUFFIX=false LATEST_ENABLED=true \
  python main.py

See examples/README.md for the full setup and available options

Installation

pip install bollhav

Testing

Tests use pytest. Run the full suite:

pytest tests/

Build + publish example

git tag 1.2.3 && git push --tags