Skip to main content

Walks directories and merges dictionaries

Project description

dwalk: walks directories, merges dictionaries

dwalk is a Python package and CLI tool for walking directories and merging dictionaries.

Installation

dwalk requires Python 3.8 or later.

pip3 install dwalk

CLI usage

dwalk --filenames FILENAME [FILENAME ...] [--directory DIRECTORY] [--include-meta]
  • --directory VALUE: Directory to walk to. The files in this directory will take priority over the files in its parent. Optional, and uses the current working directory by default.
  • --filenames LOWEST_PRECEDENCE ... HIGHEST_PRECEDENCE: Files to look for and merge in each walked directory. Files at the end of the list take precedence over files at the beginning.
  • --include-meta: Flag to indicate whether or not to include metadata on each merged property.

Example

Merging via file precedence

Say you have two configuration files:

  • example/foo.yml describes the default configuration, and:
  • example/foo.user.yml describes a user's personal configuration.
# foo.yml
prompts:
  accessibility: not-asked
  notifications: not-asked
theme: default
# foo.user.yml
accessibility:
  high-contrast: true
prompts:
  accessibility: user-enabled
theme: pink

To merge these two configurations with precedence given to the user's configuration:

dwalk --directory example --filenames foo.yml foo.user.yml
{
  "accessibility": {
    "high-contrast": true
  },
  "prompts": {
    "accessibility": "user-enabled",
    "notifications": "not-asked"
  },
  "theme": "pink"
}

Merging via directory precedence

Say you have three configuration files:

  • example/foo.yml describes the default configuration, and:
  • example/foo.user.yml describes a user's personal configuration, and:
  • example/game/foo.yml describes a sub-project's default configuration:
# example/foo.yml
prompts:
  accessibility: not-asked
  notifications: not-asked
theme: default
# example/foo.user.yml
accessibility:
  high-contrast: true
prompts:
  accessibility: user-enabled
theme: pink
# game/foo.yml
theme: sci-fi
requires:
  - gamepad

To merge these three configurations in the context of the game directory:

dwalk --directory example/game --filenames foo.yml foo.user.yml
{
  "accessibility": {
    "high-contrast": true
  },
  "prompts": {
    "accessibility": "user-enabled",
    "notifications": "not-asked"
  },
  "requires": [
    "gamepad"
  ],
  "theme": "sci-fi"
}

Metadata

Metdata can be included in the result by adding the --include-meta flag.

This will add __dwalk__ keys that describe:

  • The src file whenever a property is merged in.
  • The most_specific_src that properties were merged in from.

For example:

{
  "__dwalk__": {
    "__dwalk__": {
        "most_specific_src": "/Users/cariad/code/dwalk/example/foo.user.yml"
    },
    "accessibility": {
      "src": "/Users/cariad/code/dwalk/example/foo.user.yml"
    },
    "prompts": {
      "src": "/Users/cariad/code/dwalk/example/foo.yml"
    },
    "theme": {
      "src": "/Users/cariad/code/dwalk/example/foo.user.yml"
    }
  },
  "accessibility": {
    "high-contrast": true
  },
  "prompts": {
    "__dwalk__": {
      "accessibility": {
        "src": "/Users/cariad/code/dwalk/example/foo.user.yml"
      }
    },
    "accessibility": "user-enabled",
    "notifications": "not-asked"
  },
  "theme": "pink"
}

Package

dwalk can be imported and used in Python scripts:

from dwalk import dwalk
from logging import basicConfig, getLogger

# Log level defaults to INFO; override if you want.
# basicConfig()
# getLogger("dwalk").setLevel("DEBUG")

merged = dwalk(
    directory="../dwalk/testing/bottom",
    filenames=["dwalk.2.yml", "dwalk.1.yml"],
    include_meta=False,
)

print(merged)
# {'favourite_colour': 'purple', 'is_top_2': True, 'side_count': {'hexagon': 6,
# 'pentagon': 5, 'square': 4, 'triangle': 3}, 'alphabet': {'d': 'delta', 'c':
# 'charlie', 'b': 'bravo', 'a': 'alpha'}, 'is_top_1': True, 'is_bottom_2': True,
# 'shopping_list': ['atari', 'bismuth', 'cookies'], 'is_bottom_1': True}

Directory precedence

dwalk always starts in the current user's home directory, then walks down from the volume root to the specified directory (or the current working directory if one wasn't specified).

Thanks!

My name is Cariad Eccleston and I'm a freelance DevOps engineer. I appreciate you checking out my projects! I'm available for interesing gigs -- let's talk!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for dwalk, version 1.1.0
Filename, size File type Python version Upload date Hashes
Filename, size dwalk-1.1.0-py3-none-any.whl (10.8 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page