deped-dcp-template 0.2.1

Shared runtime helpers for DepEd DCP data-cleaning packages.

deped-dcp-template

deped-dcp-template is the shared template and normalization layer extracted from the older DepEd DCP monolith pipeline.

That earlier pipeline ingested three operational CSV sources, personnel, equipment, and connectivity, into one combined SQLite database. To make that work, it had to repair the messy freeform values submitted by schools, divisions, and regions: entity extraction, position normalization, equipment dimension canonicalization, person-link resolution, connectivity staging/promotion, and audit outputs such as unmapped_positions.txt and equipment_dimension_issues.txt.

The root cause lives in the Excel collection workbooks that DepEd distributed. This repository ships those three canonical v1.16 templates in templates/. They define the official value universe through sheets such as List of Positions, Referential Data, Regions, and SDOs, plus a Read Me sheet with fill instructions. In practice, many submitters typed freeform values instead of using the provided dropdowns, so downstream systems still need a shared cleanup layer anchored to the template catalogs.

Why This Package Exists

Downstream apps should not each:

• copy the same template files
• parse the same workbook sheets independently
• carry slightly different position and equipment normalization rules
• drift on what counts as the canonical DepEd value set

This package provides one reusable base layer so consumer packages can share the same template-derived lookups and baseline cleaning behavior.

What Happens Here

This repository currently does four things:

• ships the canonical school, division, and region Excel templates
• extracts their canonical lists into a SQLite lookup database
• exposes shared normalization helpers for identifiers, dates, phone numbers, emails, positions, and selected equipment dimensions
• exposes shared CSV/entity/personnel helper code used by downstream loaders

Running the extractor on the bundled v1.16 templates currently yields a lookup database with:

• 314 canonical positions
• 65 equipment items
• 76 equipment brands
• 18 regions
• 222 unique region-division pairs

What Downstream Packages Still Own

This package is not the full monolith rebuild. Consumer packages still own:

• end-to-end ingestion of the three operational source CSVs
• domain-specific SQLite schemas, indexes, and views
• person-link resolution policy beyond the shared helpers
• connectivity staging and promotion workflows
• final artifact contracts and audit-file emission

The shared helpers in this repository are the base layer those downstream flows build on.

Install

Published dependency:

uv add deped-dcp-template

Local development against a sibling checkout:

[tool.uv.sources]
deped-dcp-template = { path = "../deped-dcp-template" }

Build The Template Lookup DB

uv run deped-dcp-template extract \
  --templates-dir templates \
  --output artifacts/template_lookups_v1.16.db

When installed as a dependency, templates resolves to the bundled workbook directory shipped inside the package. Downstream projects do not need to copy the Excel templates into their own repository just to run the extractor.

Inspect the generated database summary:

uv run deped-dcp-template show \
  --db artifacts/template_lookups_v1.16.db

Tests

uv run pytest -q