Skip to main content

Small boiler plate with tools for multithreading.

Project description

minibone

Check Deploy PyPI version

minibone is an easy to use yet powerful boiler plate for multithreading, multiprocessing and others:

  • Config: To handle configuration settings
  • Daemon: To run a periodical task in another thread
  • HTMLBase: To render html using snippets and toml configuration file in async mode
  • Logging: To setup a logger friendly with filerotation
  • PARProcesses: To run parallel tasks as processes
  • PARThreads: To run parallel tasks in threads
  • Storing: To queue and store files periodically in a thread (queue and forget)
  • Among others (I will add more later)

It will be deployed to PyPi when a new release is created

Installation

pip install minibone

Config

Handle configuration settings in memory and/or persist them into toml/yaml/json formats

from minibone.config import Config

# Create a new set of settings and persist them
cfg = Config(settings={"listen": "localhost", "port": 80}, filepath="config.toml")	
cfg.add("debug", True)	
cfg.to_toml()

# Load settings from a file. Defaults can be set. More information: help(Config.from_toml)
cfg2 = Config.from_toml("config.toml")

# also there are async counter part methods
import asyncio

cfg3 = asyncio.run(Config.aiofrom_toml("config.toml"))

Usually config files are editted externaly then loaded as read only on your code, so in such case, you may want to subclass Config for easier usage

from minibone.config import Config

class MyConfig(Config):

    def __init__(self):
        defaults = {"main": {"listen": "localhost", "port": 80}}
        settings = Config.from_toml(filepath="config.toml", defaults=defaults)
        super().__init__(settings=settings)

    def listen(self) -> str:
        return self["main"]["listen"]

    def port(self) -> int:
        return self["main"]["port"]

if __name__ == "__main__":
    cfg = MyConfig()
    print(cfg.port())
    # it will print the default port value if not port setting was defined in config.toml

Daemon

It is just another python class to run a periodical task in another thread. It can be used in two modes: subclasing and callback

Usage as SubClass mode

  • Subclass Daemon
  • call super().init() in yours
  • Overwrite on_process method with yours
  • Add logic you want to run inside on_process
  • Be sure your methods are safe-thread to avoid race condition
  • self.lock is available for lock.acquire / your_logic / lock.release
  • call start() method to keep running on_process in a new thread
  • call stop() to finish the thread

Check sample_clock.py for a sample

Usage as callback mode

  • Instance Daemon by passing a callable
  • Add logic to your callable method
  • Be sure your callable is safe-thread to avoid race condition
  • call start() method to keep running callable in a new thread
  • call stop() to finish the thread

Check sample_clock_callback.py for a sample

Logging

Setup a logger using UTC time that outputs logs to stdin or to a file. It is friendly to filerotation (when setting output to a file)

import logging

from minibone.logging import setup_log

if __name__ == "__main__":

    # setup_log must be called only once in your code.
    # So you have to choice if logging to stderr or to a file when calling it

    setup_log(level="INFO")
    logging.info('This is a log to the stderr')

    # or call the next lines instead if you want to log into a file
    # setup_log(file="sample.log", level="INFO")
    # logging.info('yay!')

Contribution

  • Feel free to clone this repository and send any pull requests.
  • Add issues if something is not working as expected.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

minibone-0.7.1.tar.gz (51.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

minibone-0.7.1-py3-none-any.whl (40.5 kB view details)

Uploaded Python 3

File details

Details for the file minibone-0.7.1.tar.gz.

File metadata

  • Download URL: minibone-0.7.1.tar.gz
  • Upload date:
  • Size: 51.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.7

File hashes

Hashes for minibone-0.7.1.tar.gz
Algorithm Hash digest
SHA256 deef7aa2af35745fbf5faab67bf949b97c1998898e4b739c158cc065c5f8d220
MD5 669bacbc6379f2afbe3fb59ae7e4f6d7
BLAKE2b-256 0861cedde73fab2e4d172c6c4a6f873c6341cb1df749f5ea5663a7833ee4f5ab

See more details on using hashes here.

File details

Details for the file minibone-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: minibone-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 40.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.12.7

File hashes

Hashes for minibone-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 ff16b06aa18054294f876cf79631750c5bdf8d0c549984a27b5d2cd0118bc638
MD5 c7f617a44ef9bb39998964edba9bea37
BLAKE2b-256 9efab2fb35662381474b61832fa5d3f7e57b5886add7810400907a9f918f37ca

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page