Skip to main content

The janitor

Project description

https://img.shields.io/travis/snare/scruffy.svg https://img.shields.io/pypi/format/scruffington.svg https://readthedocs.org/projects/scruffy/badge/?version=latest

Scruffy. The Janitor.

Scruffy is a framework for taking care of a bunch of boilerplate in Python apps. It handles the loading of configuration files, the loading and management of plugins, and the management of other filesystem resources such as temporary files and directories, log files, etc.

A typical use case for Scruffy is a command-line Python tool with some or all of the following requirements:

  • Read a set of configuration defaults

  • Read a local configuration file and apply it on top of the defaults

  • Allow overriding some configuration options with command line flags or at runtime

  • Load a core set of Python-based plugins

  • Load a set of user-defined Python-based plugins

  • Generate log files whose name, location and other logging settings are based on configuration

  • Store application state between runs in a file or database

Scruffy is used by Voltron and Calculon

Installation

A standard python setup script is included.

$ python setup.py install

This will install the Scruffy package wherever that happens on your system.

Alternately, Scruffy can be installed with pip from PyPi (where it’s called scruffington, because I didn’t check for a conflict before I named it).

$ pip install scruffington

Documentation

Full documentation is hosted at readthedocs

Quick start

Config

Load a user config file, and apply it on top of a set of defaults loaded from inside the Python package we’re currently running from.

thingy.yaml:

some_property:  1
other_property: a thing

thingy.py:

from scruffy import ConfigFile

c = ConfigFile('thingy.yaml', load=True,
    defaults=File('defaults.yaml', parent=PackageDirectory())
)

print("c.some_property == {c.some_property}".format(c=c))
print("c.other_property == {c.other_property}".format(c=c))

Run it:

$ python thingy.py
c.some_property == 1
c.other_property == a thing

Plugins

Load some plugins.

~/.thingy/plugins/example.py:

from scruffy import Plugin

class ExamplePlugin(Plugin):
    def do_a_thing(self):
        print('{}.{} is doing a thing'.format(__name__, self.__class__.__name__))

thingy.py:

from scruffy import PluginDirectory, PluginRegistry

pd = PluginDirectory('~/.thingy/plugins')
pd.load()

for p in PluginRegistry.plugins:
    print("Initialising plugin {}".format(p))
    p().do_a_thing()

Run it:

$ python thingy.py
Initialising plugin <class 'example.ExamplePlugin'>
example.ExamplePlugin is doing a thing

Logging

Scruffy’s LogFile class will do some configuration of Python’s logging module.

log.py:

import logging
from scruffy import LogFile

log = logging.getLogger('main')
log.setLevel(logging.INFO)
LogFile('/tmp/thingy.log', logger='main').configure()

log.info('Hello from log.py')

/tmp/thingy.log:

Hello from log.py

Environment

Scruffy’s Environment class ties all the other stuff together. The other classes can be instantiated as named children of an Environment, which will load any Config objects, apply the configs to the other objects, and then prepare the other objects.

~/.thingy/config:

log_dir:    /tmp/logs
log_file:   thingy.log

env.py:

from scruffy import *

e = Environment(
    main_dir=Directory('~/.thingy', create=True,
        config=ConfigFile('config', defaults=File('defaults.yaml', parent=PackageDirectory())),
        lock=LockFile('lock')
        user_plugins=PluginDirectory('plugins')
    ),
    log_dir=Directory('{config:log_dir}', create=True
        LogFile('{config:log_file}', logger='main')
    ),
    pkg_plugins=PluginDirectory('plugins', parent=PackageDirectory())
)

License

See LICENSE file. If you use this and don’t hate it, buy me a beer at a conference some time.

Credits

Props to richo. Flat duck pride.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scruffington-0.3.8.2.tar.gz (11.8 kB view details)

Uploaded Source

Built Distribution

scruffington-0.3.8.2-py2.py3-none-any.whl (14.2 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file scruffington-0.3.8.2.tar.gz.

File metadata

  • Download URL: scruffington-0.3.8.2.tar.gz
  • Upload date:
  • Size: 11.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.9.0

File hashes

Hashes for scruffington-0.3.8.2.tar.gz
Algorithm Hash digest
SHA256 1962f974c4211192dd737aaeec621dfdbe14e7f61ff7d322170f0ba82650d940
MD5 2104f29026583c8fa1bb857b08663fec
BLAKE2b-256 03f2b6c0bb8bf83a8a13260022eb5190c911131223e341fea2e6b25e6c4b08b9

See more details on using hashes here.

File details

Details for the file scruffington-0.3.8.2-py2.py3-none-any.whl.

File metadata

  • Download URL: scruffington-0.3.8.2-py2.py3-none-any.whl
  • Upload date:
  • Size: 14.2 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.9.0

File hashes

Hashes for scruffington-0.3.8.2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 22a9413abd468d095c5f38587fee90a40a0171ca6b651973469438cb6ba56724
MD5 7c7ce05488b26bfc62ecdbc366124c56
BLAKE2b-256 26e9b1bd240357828db71783b2ff6997da68615328d5b088879d9795e9d47f99

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page