config-tpg 0.1.2

Read a config file and create a config module which can be passed throughout an application. Reading and writing of the config file are based on configparser.

config_tpg

Table of Contents

• Overview
• Requirements
• Project Structure
• Setup
• Implementation
• Customization

Overview

Provide a configuration namespace module from a configuration file. The config module can be imported into each python program which permits the passing of varibles between programs. The variables can be references as cfg.varname. Reading and writing of the config file is based upon the standard library configparser module.

Examples to list the variables in the cfg madule and demostrate referencing the variables in an application follow:

myapp.py

    from src import config as cfg

    for s, v in cfg.cfg_values.items():
        print(f"{s}: {v}")
        for var in v:
            print(f"   {var[0]}: {getattr(cfg, var[0])}")

     print(f"version: {cfg.sys_cfg_version}")

Features

• Allow values to be changed in a config file and passed into the system - no changing of source code
• Manage the config file, reading parameters into the application, creating the initial file with defaults, updating existing config file if parameters are added or names change in the config module. Pre-defined comments and config file values are preserved.
• Creates a config module that can be used to pass paramters to other modules. The values in this module are updated by the values in the config file and can be modified by the application.
• Internal objects can be added to the config module and passed to each module in application.

Requirements

This module requires python 3.10 due to use of case statement.

Standard Python packages are utilized and no special packages are needed.

Project structure

The default implementation assumes the following project structure (but this can be altered, see customization):

proj_name/
    data/
    src/
        __init__.py           (an empty file)
        config.py
        configparms_ext.py (if used)
    proj_main.py

If you have a different project structure, then the configparms_ext.py method set_directrories can be modified to set the path to the data folder and src folder of your project.

Setup

From a terminal window:

1. Install the package in your environment:

   pip install config_tpg

2. Change directories to your src folder:

   cd src

3. Copy the config file into the src directory.

   • create an empty __init__.py file in the source directory with your favorite editor

   • enter the following command:

   config_tpg-init

   This command copies two file into the current directory: config.py and configparms_ext.py

   If you do not need to modify the paths, then configparms_ext.py can be deleted.

   Rerunning config_tpg-init will not overwrite existing files, but will receate the configparms_ext.py file if it has been deleted.

4. Modify the config file to meet your application needs. Be sure to change the value of the variable cfg_flnm to the name of your config file.

5. In each module, add the import for the config. This should be the first application import, after the standard python module imports,

   import os
   import sys
   from src import config as cfg
   from src import myother_application_modules
   

6. In config.py set the autorun flag or call the run method cfg.run() in your application. See the comments at the bottom of the config file.

7. The first time you run a program with the config import, it will look for a config file in the data directory and if does not exist, it will create one.

All set!

Implementation

In each of your application programs, the src.config module should be imported as the first application import in each application module.

import src.config as cfg

The first import reads the config file (data/xxxxx.cfg) and loads the runtime values. If the cfg file, as named in the variable cfg.cfg_flnm, does not exist, it is created with the default values.

The config module creates a module as a namespace so variables can be referenced as cfg.var. Each variable is defined with its default value in the namespace, unless overridden by the config file. A config file, xxxxx.cfg is created on the first import of config if it does not exist, where xxxxx is name as set in the variable cfg.cfg_flnm.

Any changes to the cfg file in the data folder are local and override the defaults.

If a new variable is added in the src.config module or if the variable name changes in the config module, then the version number should be updated in the config module (not the config file). When the cfg module version and the config file version differ, a rewrite the local cfg file will be triggered with the new changes, perserving any values previously set in the file.

Modifying config.py

Two programs from this repo are provided for use by your application:

• scr/config.py
• src/configparms_ext.py (optional for customization)

config.py

It is intended for the config.py file to be modified for the application. Parameters unique to the application are defined with their defaults. Replace the var1-3 and m1-2 variables with the variables needed by the application. Also set the cfg filename (cfg_flnm).

The sys_cfg_version variable must not be deleted, it will be updated as new parameters are added to the config file and the change in this value triggers the rewrite of the file.

Variables

The cfg_values is a dictionary that defines the sections and variables to be written to the config file. The key to the dictionary is the section and the value is a list of lists with variable name and variable type (see sample in config.py).

Be sure all variables to be in the config file are defined in the cfg_values variable.

Valid types supported are

• integer
• float
• boolean
• string
• list

Comments

The variable cfg_comments contains any comment to be written to the config file to explain a variable or section.

Section comments are written after the section label and variable comments are written before the variable in the config file.

The cfg_comments variable is a dictionary and the key is the variable or section name and the value is a list with each item in the list being written as a seperate comment line.

configparms_ext.py

To override setting of path variables, the configparm_ext.py module is provided.

Modify the method set_directories to support the structure of your project.

See the customization doc to modidify standard processing.

Summary of set up

• Install the package
• Run config_tpg-init to extract the src/config.py and configparms_ext.py and place in your project src file
• Modify these modules for your application (set the config file name and variables)
• import the module into your application