11 projects
gcp-pipeline-ref-orchestration
GCP Pipeline Reference: Generic Orchestration - Airflow DAGs for Cloud Composer (JOIN + MAP patterns)
gcp-pipeline-ref-segment-transform
GCP Pipeline Reference: Mainframe Segment Transform — CDP → fixed-width GCS segment files
gcp-pipeline-ref-cdp
GCP Pipeline Reference: Generic CDP Transformation — dbt models for FDP to CDP (JOIN pattern across all 3 FDP tables)
gcp-pipeline-ref-ingestion
Reference Implementation: GCS-to-BigQuery Ingestion Pipeline using gcp-pipeline-framework
gcp-pipeline-ref-transform
GCP Pipeline Reference: Generic FDP Transformation — dbt models for ODP to FDP (JOIN + MAP patterns)
gcp-pipeline-framework
Umbrella package for GCP Data Migration Pipeline Libraries
gcp-pipeline-tester
Testing framework for GCP data pipelines with mocks, fixtures, and assertions
gcp-pipeline-transform
Transform library for GCP data pipelines (dbt macros)
gcp-pipeline-beam
Beam ingestion library for GCP data pipelines
gcp-pipeline-orchestration
Orchestration library for GCP data pipelines
gcp-pipeline-core
Core library for GCP data pipelines