Database-backed Periodic Tasks.
Project description
- Version:
2.7.0
- Web:
- Download:
- Source:
- Keywords:
django, celery, beat, periodic task, cron, scheduling
About
This extension enables you to store the periodic task schedule in the database.
The periodic tasks can be managed from the Django Admin interface, where you can create, edit and delete periodic tasks and how often they should run.
Using the Extension
Usage and installation instructions for this extension are available from the Celery documentation.
Important Warning about Time Zones
>>> from django_celery_beat.models import PeriodicTask, PeriodicTasks
>>> PeriodicTask.objects.all().update(last_run_at=None)
>>> PeriodicTasks.update_changed()
Models
django_celery_beat.models.PeriodicTask
This model defines a single periodic task to be run.
It must be associated with a schedule, which defines how often the task should run.
django_celery_beat.models.IntervalSchedule
A schedule that runs at a specific interval (e.g. every 5 seconds).
django_celery_beat.models.CrontabSchedule
A schedule with fields like entries in cron: minute hour day-of-week day_of_month month_of_year.
django_celery_beat.models.PeriodicTasks
This model is only used as an index to keep track of when the schedule has changed.
Whenever you update a PeriodicTask a counter in this table is also incremented, which tells the celery beat service to reload the schedule from the database.
If you update periodic tasks in bulk, you will need to update the counter manually:
>>> from django_celery_beat.models import PeriodicTasks
>>> PeriodicTasks.update_changed()
Example creating interval-based periodic task
To create a periodic task executing at an interval you must first create the interval object:
>>> from django_celery_beat.models import PeriodicTask, IntervalSchedule
# executes every 10 seconds.
>>> schedule, created = IntervalSchedule.objects.get_or_create(
... every=10,
... period=IntervalSchedule.SECONDS,
... )
That’s all the fields you need: a period type and the frequency.
You can choose between a specific set of periods:
IntervalSchedule.DAYS
IntervalSchedule.HOURS
IntervalSchedule.MINUTES
IntervalSchedule.SECONDS
IntervalSchedule.MICROSECONDS
There’s also a “choices tuple” available should you need to present this to the user:
>>> IntervalSchedule.PERIOD_CHOICES
Now that we have defined the schedule object, we can create the periodic task entry:
>>> PeriodicTask.objects.create(
... interval=schedule, # we created this above.
... name='Importing contacts', # simply describes this periodic task.
... task='proj.tasks.import_contacts', # name of task.
... )
Note that this is a very basic example, you can also specify the arguments and keyword arguments used to execute the task, the queue to send it to[*], and set an expiry time.
Here’s an example specifying the arguments, note how JSON serialization is required:
>>> import json
>>> from datetime import datetime, timedelta
>>> PeriodicTask.objects.create(
... interval=schedule, # we created this above.
... name='Importing contacts', # simply describes this periodic task.
... task='proj.tasks.import_contacts', # name of task.
... args=json.dumps(['arg1', 'arg2']),
... kwargs=json.dumps({
... 'be_careful': True,
... }),
... expires=datetime.utcnow() + timedelta(seconds=30)
... )
Example creating crontab-based periodic task
A crontab schedule has the fields: minute, hour, day_of_week, day_of_month and month_of_year, so if you want the equivalent of a 30 * * * * (execute 30 minutes past every hour) crontab entry you specify:
>>> from django_celery_beat.models import CrontabSchedule, PeriodicTask
>>> schedule, _ = CrontabSchedule.objects.get_or_create(
... minute='30',
... hour='*',
... day_of_week='*',
... day_of_month='*',
... month_of_year='*',
... timezone=zoneinfo.ZoneInfo('Canada/Pacific')
... )
The crontab schedule is linked to a specific timezone using the ‘timezone’ input parameter.
Then to create a periodic task using this schedule, use the same approach as the interval-based periodic task earlier in this document, but instead of interval=schedule, specify crontab=schedule:
>>> PeriodicTask.objects.create(
... crontab=schedule,
... name='Importing contacts',
... task='proj.tasks.import_contacts',
... )
Temporarily disable a periodic task
You can use the enabled flag to temporarily disable a periodic task:
>>> periodic_task.enabled = False
>>> periodic_task.save()
Example running periodic tasks
The periodic tasks still need ‘workers’ to execute them. So make sure the default Celery package is installed. (If not installed, please follow the installation instructions here: https://github.com/celery/celery)
Both the worker and beat services need to be running at the same time.
Start a Celery worker service (specify your Django project name):
$ celery -A [project-name] worker --loglevel=info
As a separate process, start the beat service (specify the Django scheduler):
$ celery -A [project-name] beat -l info --scheduler django_celery_beat.schedulers:DatabaseScheduler
OR you can use the -S (scheduler flag), for more options see celery beat --help):
$ celery -A [project-name] beat -l info -S django
Also, as an alternative, you can run the two steps above (worker and beat services) with only one command (recommended for development environment only):
$ celery -A [project-name] worker --beat --scheduler django --loglevel=info
Now you can add and manage your periodic tasks from the Django Admin interface.
Installation
You can install django-celery-beat either via the Python Package Index (PyPI) or from source.
To install using pip:
$ pip install --upgrade django-celery-beat
Downloading and installing from source
Download the latest version of django-celery-beat from http://pypi.python.org/pypi/django-celery-beat
You can install it by doing the following :
$ python3 -m venv .venv
$ source .venv/bin/activate
$ pip install --upgrade build pip
$ tar xvfz django-celery-beat-0.0.0.tar.gz
$ cd django-celery-beat-0.0.0
$ python -m build
$ pip install --upgrade .
After installation, add django_celery_beat to Django’s settings module:
INSTALLED_APPS = [
...,
'django_celery_beat',
]
Run the django_celery_beat migrations using:
$ python manage.py migrate django_celery_beat
Using the development version
With pip
You can install the latest main version of django-celery-beat using the following pip command:
$ pip install git+https://github.com/celery/django-celery-beat#egg=django-celery-beat
Developing django-celery-beat
To spin up a local development copy of django-celery-beat with Django admin at http://127.0.0.1:58000/admin/ run:
$ docker-compose up --build
Log-in as user admin with password admin.
TZ Awareness:
If you have a project that is time zone naive, you can set DJANGO_CELERY_BEAT_TZ_AWARE=False in your settings file.
django-celery-beat as part of the Tidelift Subscription
The maintainers of django-celery-beat and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use. Learn more.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for django_celery_beat-2.7.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 851c680d8fbf608ca5fecd5836622beea89fa017bc2b3f94a5b8c648c32d84b1 |
|
MD5 | 8c681c4bec7068d6ddbf6fd77d0ab0af |
|
BLAKE2b-256 | 29f8f5a25472222b19258c3a53ce71c4efd171a12ab3c988bb3026dec0522a64 |