Skip to main content

Simplified, scalable task scheduling with typechecking.

Project description

beatdrop

See the full Documentation.

The goal of beatdrop is to provide schedulers and schedule entries that are easy to use, extensible, scalable, and backend agnostic.

It does not run tasks or python functions on a schedule. It will simply interface with task backends to send tasks when they are due.

Installation

Install the base package with pip from PyPi.

$ pip install beatdrop

For particular schedulers and backends you will also need to install their extra dependencies.

$ pip install beatdrop[redis]

Extra dependencies for task backends:

  • celery

Extra dependencies for scheduler storage:

  • redis

  • sql

The all extra dependency will install all extra dependencies for task backends and scheduler storage.

$ pip install beatdrop[all]

Usage

There are 2 main pieces to using beatdrop.

  • Schedule Entry - holds the task definitions and scheduling info.

  • Schedulers - have 2 main roles

    • They can be run as a scheduler to monitor and send tasks to the task backend.
    • Act as clients for reading and writing schedule entries.

To run the scheduler simply make a python file, create the scheduler and call the run method:

from beatdrop import CeleryRedisScheduler

from my_app import celery_app


sched = CeleryRedisScheduler(
    max_interval=60,
    celery_app=celery_app,
    lock_timeout=180,
    redis_py_kwargs={
        "host": "my.redis.host",
        "port": 6379,
        "db": 0,
        "password": "mys3cr3t"
    }
)
sched.run()

To use the scheduler as a client, you create the scheduler the same as you would to run it:

from beatdrop import CeleryRedisScheduler, IntervalEntry

from my_app import celery_app


# Create a scheduler
sched = CeleryRedisScheduler(
    max_interval=60,
    celery_app=celery_app,
    lock_timeout=180,
    redis_py_kwargs={
        "host": "my.redis.host",
        "port": 6379,
        "db": 0,
        "password": "mys3cr3t"
    }
)
# create a schedule entry
inter = IntervalEntry(
    key="my-interval-entry",
    enabled=True,
    task="test_task",
    args=("my_args", 123),
    kwargs={
        "my_kwargs": 12.4
    },
    period=10
)

# save or update an entry 
sched.save(inter)
# list all entries, this will automatically paginate
schedule_entries = sched.list()
# retrieve a specific entry
my_inter_entry = sched.get(inter.key)
# equivalent to the line above
my_inter_entry = sched.get("my-interval-entry")
# Delete an entry from the scheduler
sched.delete(inter)

Changelog

Changelog for beatdrop. All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.1.0a7] - 2023-02-25

Fixed

- tests 
- docs

[0.1.0a6] - 2023-02-22

Added

  • RQScheduler - Building block scheduler for the RQ (Redis Queue) task backend.
  • RQRedisScheduler - Complete scheduler with RQ task backend and redis entry storage.
  • RQSQLScheduler - Complete scheduler with RQ task backend and SQL DB entry storage.

Fixed

  • PYPI logo

[0.1.0a5] - 2023-02-06

Fixed

  • packaging files
  • README Links

[0.1.0a4] - 2023-02-05

Fixed

Docstrings updated and documentation added.

[0.1.0a3] - 2023-01-18

Update for pypi formatting.

[0.1.0a2] - 2023-01-17

Update for pypi formatting.

[0.1.0a1] - 2023-01-17

Initial release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

beatdrop-0.1.0a7.tar.gz (35.9 kB view details)

Uploaded Source

Built Distribution

beatdrop-0.1.0a7-py3-none-any.whl (35.3 kB view details)

Uploaded Python 3

File details

Details for the file beatdrop-0.1.0a7.tar.gz.

File metadata

  • Download URL: beatdrop-0.1.0a7.tar.gz
  • Upload date:
  • Size: 35.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.2

File hashes

Hashes for beatdrop-0.1.0a7.tar.gz
Algorithm Hash digest
SHA256 7477d10083213abe35dbf99d312cf24b6c8eeb90ee04f27cc485e977120fef8a
MD5 b6dec658576979bcac0eca70429dd3f2
BLAKE2b-256 3e41526253d03e0af59cc96eb9ec047024abf74f8594e1f5c41d052793fd285c

See more details on using hashes here.

File details

Details for the file beatdrop-0.1.0a7-py3-none-any.whl.

File metadata

  • Download URL: beatdrop-0.1.0a7-py3-none-any.whl
  • Upload date:
  • Size: 35.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.2

File hashes

Hashes for beatdrop-0.1.0a7-py3-none-any.whl
Algorithm Hash digest
SHA256 60e89f82f9aa8e0816f58d86ded47ee9034cb6f269a133a4748463c5320c494f
MD5 d2c1bcef8691be0865d353edd1316cd1
BLAKE2b-256 dba955c31d775d8d8429692e59f51447243936ee594af28904076379c4af0e3a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page