Skip to main content

Read and manage config from environment variables and files

Project description

Klein Config

Module to provide config management

Usage

from klein_config import get_config

# Can be overriden with env variable MY_CONFIG_SETTING
config = get_config({"my": {"config": {"setting": "initialised value"}})

# Access via `get` accessor with no backup (raises ConfigMissingException if not found).
value = config.get("my.config.setting")

# Access via `get` accessor method with a backup.
backup_value = config.get("not.a.setting", "backup value")

# Access via `dict` (raises KeyError if not found).
same_value = config["my.config.setting"]

# Sub-configs are created if the value is another `dict`.
intermediate_config = config["my.config"]
same_value_again = intermediate_config["setting"]

Structure

Internally the config object uses the ConfigTree structure that is part of pyhocon. This can be traversed easily with the get method using dot notation as outlined above.

Config Initialisation

The get_config function looks for :

  • argument --common or environmental variable KLEIN_COMMON to specify a valid filepath for a common config file (in either JSON or YAML format); and
  • argument --config or environmental variable KLEIN_CONFIG to specify a valid filepath for a config file

N.B. Passing both environmental variables and arguments for either config or common is ambiguous and is therefore NOT accepted.

You can also pass a dict into the get_config function.

Example configs

JSON:

{
  "rabbitmq": {
    "host": [
      "localhost"
    ],
    "port": 5672,
    "username": "username",
    "password": "password"
  },
  "mongo": {
    "host": [
      "mongo.domain.com"
    ],
    "username": "username",
    "password": "password"
  }
}

YAML:

mongo:
  host:
    - mongo.domain.com
  password: password
  username: username
rabbitmq:
  host:
    - localhost
  password: username
  port: 5672
  username: password

Example config files are also provided in json and yaml formats.

Order precedence

The configs are applied to the config object in the following order:

  1. Common config as identified via argument --common or environmental variable KLEIN_COMMON
  2. Config that is injected via the Class constructor
  3. Config that is identified via the argument --config or environmental variable KLEIN_CONFIG

Configs will override any previous values as they are applied.

Environment Aware

The module is "Environment Aware", i.e. it will look for environment variables in the first instance. If a valid variable exists then this will be used regardless of any config that may have been supplied.

The path is transformed by converting the string to uppercase and replacing all dots with underscores.

my.config.setting => MY_CONFIG_SETTING

Sub-config items are still overriden by the same environment variables as in the root config.

Development

This project uses pipenv. To install it, run pip install pipenv.

Development

pipenv install --dev

Testing

pipenv run python -m pytest

For test coverage you can run:

pipenv shell
pipenv run python -m pytest --cov-report term --cov src/ tests/

Troubleshooting

If you are unable to run pipenv shell and are having permission errors, you can spin up a virtual environment in which to run the pipenv commands:

pip install virtualenv      // install virtualenv module
virtual env venv            // create your virtual environment (run command from project root directory)
source venv/bin/activate    // start the virtual environment
pipenv install --dev        // install dependencies - you should now be able to run the tests with the above commands

License

This project is licensed under the terms of the Apache 2 license, which can be found in the repository as LICENSE.txt

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

klein_config-3.1.10.tar.gz (8.2 kB view hashes)

Uploaded Source

Built Distribution

klein_config-3.1.10-py3-none-any.whl (8.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page