Skip to main content

A small, schema-driven YAML object merger and validator

Project description

config-cascade-merge

A small, schema-driven YAML object merger and validator written in Python. It loads a base schema and validates ordered overlay operations against it.

Installation

config-cascade-merge requires Python 3.10 or newer.

python -m pip install config-cascade-merge

You can also install the latest development version directly from GitHub:

python -m pip install git+https://github.com/149segolte/config-cascade-merge.git

Quick start

config-cascade-merge --base_config base.yaml --overlays_dir overlays/

The executable also supports short options:

config-cascade-merge -b base.yaml -o overlays/

The module form is equivalent:

python -m config_cascade_merge -b base.yaml -o overlays/

Library usage

Use load_merge_plan to load the same validated data without invoking the command-line interface:

from config_cascade_merge import ConfigError, load_merge_plan

try:
    plan = load_merge_plan("base.yaml", "overlays/")
except ConfigError as error:
    print(f"Invalid configuration: {error}")
else:
    if plan is not None:
        print(plan.schema)
        for operation in plan.operations:
            print(operation.action, operation.path)

load_merge_plan returns a MergePlan containing the normalized schema and the ordered, validated operations. An empty base file returns None, matching the CLI behavior. The function does not configure logging or exit the calling process. Schema and overlay failures derive from ConfigError, with the more specific SchemaError and OverlayError types available when callers need to distinguish them.

Base schema

The base file describes the allowed configuration shape rather than containing configuration values.

# base.yaml
type: object
keys:
    profile:
        type: object
        keys:
            name:
                type: string
            active:
                type: boolean
    packages:
        type: list
        id: name
        value:
            type: object
            keys:
                name:
                    type: string
                version:
                    type: integer
    labels:
        type: map
        value:
            type: string

Schema types

Type Purpose Main fields
string, integer, float, boolean, any Primitive value -
object Fixed-key mapping keys, optional merge, optional id
map Arbitrary-key mapping with uniform values value, optional merge, optional id
list Ordered values with a uniform item schema value, optional merge, optional id
union Value matching one of at least two schemas value (list of schemas)
tagged_union Object selected by a discriminator field keys, tag.name, tag.options

The merge policy is either append (default) or override. An id identifies values for identity-based merging. These policies are normalized and validated now; merge execution is not yet implemented.

Example tagged union:

type: tagged_union
keys:
    label:
        type: string
tag:
    name: kind
    options:
        file:
            path:
                type: string
        service:
            port:
                type: integer
        disabled: null

Overlays

Each overlay has a non-empty name and an ordered list of operations. Paths start with .; . addresses the schema root.

# overlays/10-workstation.yaml
name: workstation
operations:
    - action: set
      path: .profile
      data:
          name: Ada
          active: true

    - action: merge
      path: .packages
      data:
          - name: ruff
            version: 1

    - action: test
      path: .profile.name
      data: Ada
      on_fail: warn
      message: unexpected profile

    - action: remove
      path: .labels.legacy

    - action: clear
      path: .packages

Operations

Action Behavior Required fields
set Creates or replaces a value; data must fully match the target schema path, data
merge Validates a recursive merge into an object, map, or list path, data
remove Nulls a fixed object field or deletes a dynamic map entry path
test Checks equality before later execution path, data; optional on_fail, message
clear Removes all entries from a map or list path

test.on_fail accepts:

  • error — stop execution (default)
  • warn — report the optional message and continue
  • skip — keep prior operations from this overlay and skip the remainder
  • drop — discard all operations from this overlay

These failure behaviors are represented by normalized operations but are not executed yet.

Validation and errors

The validator rejects malformed YAML, invalid schemas, unknown paths or fields, incompatible values, and unsupported operations. Errors include source filenames and line numbers when available:

overlays/10-workstation.yaml:8: Data at '.packages[0].version' must be integer, got str

The CLI exits with status 1 for invalid paths, schemas, or overlays. An empty base file exits successfully without processing overlays.

Development

Clone the repository, install development dependencies, and run the test suite:

git clone https://github.com/149segolte/config-cascade-merge.git
cd config-cascade-merge
uv sync --dev
uv run pytest

Build both source and wheel distributions:

uv build

Project layout:

src/config_cascade_merge/api.py         high-level library API
src/config_cascade_merge/cli.py         CLI entry point
src/config_cascade_merge/schema.py      schema parsing and normalization
src/config_cascade_merge/overlay.py     overlay loading and validation
src/config_cascade_merge/yaml_loader.py YAML loading with source locations
tests/                                  pytest test suite

See CONTRIBUTING.md for the contribution and release process.

License

Licensed under the Mozilla Public License 2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

config_cascade_merge-0.7.0.tar.gz (22.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

config_cascade_merge-0.7.0-py3-none-any.whl (22.6 kB view details)

Uploaded Python 3

File details

Details for the file config_cascade_merge-0.7.0.tar.gz.

File metadata

  • Download URL: config_cascade_merge-0.7.0.tar.gz
  • Upload date:
  • Size: 22.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for config_cascade_merge-0.7.0.tar.gz
Algorithm Hash digest
SHA256 e8232a075d6dcaaf42fac64bdc2171f39b4e90916f5c9fa59185178b83819210
MD5 00a8cdec7430dce33ea572683ffa0646
BLAKE2b-256 3a1f3c60f94597e773f0a74d32dfe3c40113217609d2c86d55efcbfd370633fe

See more details on using hashes here.

File details

Details for the file config_cascade_merge-0.7.0-py3-none-any.whl.

File metadata

File hashes

Hashes for config_cascade_merge-0.7.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2ada08b49d4ff998cdab567404fd6ad421ec99d89970279886bcb0649f1ff82c
MD5 8324e59afef958456b36f2c88e818dbf
BLAKE2b-256 cc0e93c880723a63e2923cff7f80b0f79bc5cab358b69090e95d2e7f164733b4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page