Skip to main content

Easy configurable workers based on asyncio

Project description

https://img.shields.io/pypi/v/aioworkers.svg https://img.shields.io/travis/aioworkers/aioworkers.svg https://codecov.io/gh/aioworkers/aioworkers/branch/master/graph/badge.svg Documentation Status Updates https://img.shields.io/pypi/pyversions/aioworkers.svg

Easy configurable workers based on asyncio

Features

  • Specify abstract class for communication between components

  • Configuration subsystem

History

0.11.4 (2018-06-29)

  • Fix send config to stdin subprocess

0.11.3 (2018-06-23)

  • Check signature of class entity

  • Method Config.load_plugin

  • Flag force for search_plugins

0.11.2 (2018-06-13)

  • Fix unicode README.rst

  • Fix init ExecutorEntity

0.11.1 (2018-05-15)

  • Additional params for get_int, get_float..

  • Autoload configs by mask plugin* only for package

  • Drop deprecated modules amqp, redis, app

0.11 (2018-05-08)

  • Config now is immutable

  • Config support extendable methods such as get_int, get_float..

  • Plugin.configs is sequence of config files of plugin

  • Methods set_context and set_config of entities

  • label obj for config to attach already created entities

  • Support run process with ipykernel

  • Dropped module aioworkers.config

  • Dropped deprecated class aioworkers.http.Application

0.10.2 (2018-03-25)

  • MergeDict supported uri as key

  • Catch ProcessLookupError on Subprocess.stop

0.10.1 (2018-02-28)

  • Improved Subprocess (aioworkers param)

  • Fix cli.main with args

0.10.0 (2018-02-22)

  • Improved Subprocess

  • Access member of entity over context

  • Proxy queue for readline from stdin

  • Command line param –config-stdin

0.9.3 (2017-12-22)

  • Fix FileSystemStorage.get_free_space

  • Improve import_name

0.9.2 (2017-12-17)

  • Fix access to nested element

  • Improve import_name

0.9.1 (2017-12-11)

  • Fix config loader ini

0.9.0 (2017-12-11)

  • Application is a regular entity not required in context

  • Fix load config from http resource

  • Search config in plugin by mask plugin.*

  • Extends info about fail import in import_name

0.8.0 (2017-11-17)

  • Added AsyncPath based on PurePath

  • FileSystemStorage.raw_key -> AsyncPath (backward incompatible)

  • FileSystemStorage support nested interface

  • Fix Worker.init with uninitialized queue

  • Humanize func parse_size & parse_duration

  • Prevent branching when accessing private attributes for nested obj

  • Move AbstractReader & AbstractWriter to core

  • Fix GroupResolver to resolve exclude many groups

0.7.0 (2017-11-04)

  • Plug-in formatters and config_loaders

  • Added ChainFormatter for specify pipeline

  • cli support url for config

  • ZlibFormatter + LzmaFormatter

  • AbstractNestedEntity

  • Supervisor with queue for children

  • Identifying the problem at the start of a worker

  • Mark deprecated modules

0.6.2 (2017-10-12)

  • Added support plugins

  • HttpStorage support timeout and not checks status with return_status

  • Method HttpStorage.reset_session to session_params

  • Fixed interactive mode

  • Added docs articles

0.6.1 (2017-09-24)

  • Improved HttpStorage and FileSystemStorage

  • Added example monitoring with graphite

  • Fix match negative number in ini config

  • Calling a worker launches a coro

0.6.0 (2017-06-27)

  • Added commands param in cli

  • Added classes for ContextProcessor and FileLoader family

  • Context now contextmanager

0.5.1 (2017-06-09)

  • Change grouping cli params (no backward compatibility)

  • Add cwd in sys.path with cli

  • Auto execution func & add utils.module_path

0.5.0 (2017-05-17)

  • Grouping

  • FieldStorageMixin

  • Logging level instead root logger level in params cli

  • find-links param in PipUpdater

  • Open csv in init coro DictReader queue

0.4.5 (2017-04-13)

  • Atomic set in FileSystemStorage

  • Correct default crontab in updater

0.4.4 (2017-04-12)

  • BaseUpdater

  • Example PingPong

0.4.3 (2017-04-10)

  • FileSystemStorage fix for windows

0.4.2 (2017-04-05)

  • FileSystemStorage method wait free space

  • Module humanize

  • Example of a cron worker

0.4.1 (2017-03-23)

  • Context access optimization

  • Logging cli parameter to specify log level for root logger

  • Validate config param and load from io object

  • Interact await function

  • Fix aiohttp 2.0 import

0.4.0 (2017-03-12)

  • Added ScoreQueue interface

  • Implements ScoreQueue in TimestampQueue and RedisZQueue

  • Lock refactor with catch aioredis.PoolClosedError

  • Added interact mode in cli power by ipython

  • Added amqp queue power by asynqp

  • Explicity setup signals to stop

  • Crontab rule in worker

  • Fix stopped mistake in worker

  • Fix merge MergeDict and subclass dict

0.3.3 (2017-02-22)

  • Refactor http storage

  • RedisStorage based on AbstractListedStorage

0.3.2 (2017-02-20)

  • StorageError in method set http storage

0.3.1 (2017-02-18)

  • Fix redis script in TimestampZQueue

0.3.0 (2017-02-17)

  • Added FutureStorage

  • Added TimestampZQueue on redis

  • Added Subprocess and Supervisor workers

  • Added method copy and move for Storage

  • Propagate file extension in HashFileSystemStorage

  • Added method to AbstractStorage raw_key

  • Cli refactor

  • Added counter in Worker

  • Used app startup and shutdown signals

  • Contains for MergeDict

  • Base Queue maxsize optional

0.2.0 (2016-12-05)

  • Added Worker and TimestampQueue

  • Added classes queue and storage worked over redis

  • Added Formatter and used one in FileSystemStorage and redis classes

  • Changes in Context

  • Fixed HttpStorage and used yarl.URL

0.1.0 (2016-11-25)

  • Added entities loader

  • Added abstract storage

  • Fixed configuration

  • Changes in BaseApplication

0.0.1 (2016-11-13)

  • Subsystem loading config

  • Base application and cli

  • Base queue and csv.DictReader

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aioworkers-0.12a5.tar.gz (29.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page