Skip to main content

A Celery Beat Scheduler that uses MongoDB to store both schedule definitions and status information

Project description

This is a Celery Beat Scheduler (http://celery.readthedocs.org/en/latest/userguide/periodic-tasks.html) that stores both the schedules themselves and their status information in a backend Mongo database. It can be installed by installing the celerybeat-mongo Python egg:

# pip install celerybeat-mongo

And specifying the scheduler when running Celery Beat, e.g.:

$ celery beat -S celerybeatmongo.schedulers.MongoScheduler

Settings for the scheduler are defined in your celery configuration file similar to how other aspects of Celery are configured:

CELERY_MONGODB_SCHEDULER_DB = "celery"
CELERY_MONGODB_SCHEDULER_COLLECTION = "schedules"
CELERY_MONGODB_SCHEDULER_URL = "mongodb://userid:password@hostname:port"

If not settings are specified, the library will attempt to use the schedules collection in the local celery database.

Schedules can be manipulated in the Mongo database using the mongoengine models in celerybeatmongo.models or through direct database manipulation. There exist two types of schedules, interval and crontab.

Interval:

{
    "_id" : ObjectId("533c5b29b45a2092bffceb13"),
    "name" : "interval test schedule",
    "task" : "task-name-goes-here",
    "enabled" : true,
    "interval" : {
        "every" : 5,
        "period" : "minutes"
    },
    "args": ["param1", "param2"]
    "kwargs" : {
        "max_targets" : 100
    },
    "total_run_count" : 5
    "last_run_at" : ISODate("2014-04-03T02:19:22.666Z"),
}

Crontab:

{
    "_id" : ObjectId("533c5b29b45a2092bffceb13"),
    "name" : "crontab test schedule",
    "task" : "task-name-goes-here",
    "enabled" : true,
    "crontab" : {
        "minute": "30",
        "hour": "2",
        "day_of_week": "*",
        "day_of_month": "*",
        "day_of_year": "*",
    },
    "args": ["param1", "param2"]
    "kwargs" : {
        "max_targets" : 100
    },
    "total_run_count" : 5
    "last_run_at" : ISODate("2014-04-03T02:19:22.666Z"),
}

The following fields are required: name, task, crontab || interval, enabled when defining new tasks. total_run_count and last_run_at are maintained by the scheduler and should not be externally manipulated.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

celerybeat-mongo-0.0.2.tar.gz (4.0 kB view details)

Uploaded Source

File details

Details for the file celerybeat-mongo-0.0.2.tar.gz.

File metadata

File hashes

Hashes for celerybeat-mongo-0.0.2.tar.gz
Algorithm Hash digest
SHA256 5ffc2ffa42fec99744da5bf45694e7352ae9698a4434b3f1e31ecd8551e4d749
MD5 a83997afec3613347d769d361f161120
BLAKE2b-256 bbaa5bfdb78cfde1fcf35df7f56b30bdafa5850f6de934cf89f01c74bf4ee17d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page