Skip to main content

Powerful and clean YAML-based configuration library for Python 3.11+

Project description

ymlmaster

ymlmaster is a configuration loading utility for Python 3.11+. It provides a unified interface for loading deeply structured YAML configuration files (optionally combined with .env overrides) into statically typed Python classes using either dataclass or pydantic.

Features

  • Schema generation from YAML into @dataclass or Pydantic models
  • Nested structures supported automatically
  • Optional .env merging with environment variable fallback
  • Profile support (e.g., dev, release)
  • CLI generator for schema models

Installation

Installation is done in the project using pip or poetry:

pip install ymlmaster
poetry add ymlmaster

Model Generation CLI

To generate data models from a YAML configuration file:

poetry run generate-schema
  --settings settings.yml
  --output settings_model.py
  --type dataclass # or --type pydantic,  default: dataclass
  --profile dev # or custom name block,  default: dev
  --url-fields postgresql redis # added url services

This will generate Python code like:

@dataclass
class Postgresql:
    host: Optional[str] = None
    user: Optional[str] = None
    password: Optional[str] = None
    port: Optional[str] = None
    db: Optional[str] = None

@dataclass
class Redis:
    host: Optional[str] = None
    port: Optional[str] = None

@dataclass
class Application:
    token: Optional[str] = None
    admin_id: Optional[str] = None

@dataclass
class Settings:
    postgresql: Postgresql = None
    redis: Redis = None
    application: Application = None
    postgresql_url: Optional[str] = None
    redis_url: Optional[str] = None

Using the Loader

You can then load values from settings.yml and .env into your model:

from pathlib import Path
from ymlmaster import SettingsLoader
from <settings-model> import Settings

loader = SettingsLoader(
    settings_path=Path("settings.yml"),
    env_path=Path(".env"),
    model_class=Settings,
    use_release=False, # true - release block, false - dev
    profile=None, # specify the exact loading block
    url_templates={
        "postgresql": "postgresql+asyncpg",
        "redis": "redis",
        "nats": "nats"
    } # url generation instructions   <block name>:<circuit name>
)

config = loader.load()

print(config.redis.host)
print(config.application.admin_id)

Environment Variable Override Behavior

  • Values from .env are injected only if the YAML value is null
  • Nested overrides use __ as separator:
    • For application.tokenAPPLICATION__TOKEN
    • For redis.portREDIS__PORT

If the key ends with port and is an integer, a default IP of 127.0.0.1: is prepended unless already present.

This separation helps to use sensitive data in Dockerfile/DockerCompose and in your project at once Example docker-compose.yml:

services:
  q3s2j0pj0fuj:
    image: "postgres:17"
    container_name: "q3s2j0pj0fuj"
    environment:
      POSTGRES_DB: ${POSTGRESQL__DB}
      POSTGRES_USER: ${POSTGRESQL__USER}
      POSTGRES_PASSWORD: ${POSTGRESQL__PASSWORD}
    ports:
      - "${POSTGRESQL__PORT}:5432"
    logging:
      driver: "json-file"
      options:
        max-size: "10m"
        max-file: "3"
    networks:
      - Network
    restart: always

MIT LICENSE

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ymlmaster-0.0.2.2.tar.gz (6.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ymlmaster-0.0.2.2-py3-none-any.whl (7.1 kB view details)

Uploaded Python 3

File details

Details for the file ymlmaster-0.0.2.2.tar.gz.

File metadata

  • Download URL: ymlmaster-0.0.2.2.tar.gz
  • Upload date:
  • Size: 6.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ymlmaster-0.0.2.2.tar.gz
Algorithm Hash digest
SHA256 4a1489f66dd0ca94363a764544c4d10d92a48b7026d26bffb93a4d112fc191aa
MD5 2699644f080b5a4a29851f7b31e4d173
BLAKE2b-256 3331dc595a5c90dba1a6f026adf529583bd6a806fcfac4e8c8d436f3612b4a9f

See more details on using hashes here.

File details

Details for the file ymlmaster-0.0.2.2-py3-none-any.whl.

File metadata

  • Download URL: ymlmaster-0.0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 7.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ymlmaster-0.0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 b2587aa5c5208c4e110e138f7aba5be4627c6e3fed1f0698f787436aab4674c0
MD5 235f016273f0db6e206c53caef075d6a
BLAKE2b-256 49b21c2d16c297ab3a46931a9f6e915b91e3d04080d487a77f57e4b96bebf9bc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page