Python library for logging celery events
Project description
Celery Logger
celery-logger is a python library for logging celery events such as tasks received, tasks failed/succeeded and tasks retried, along with task args.
Features
- Simple and flexible task logs
- Multiple deployment options (docker, virtual machines)
- Integration possibilities: ELK stack and AWS cloudwatch for example
How does it work?
Celery-logger connects with your message broker (such as redis, rabbitMQ or SQS) and logs the tasks on a file or stdout.
This way you can easily have multiple celery workers and see your logs in a single place.
Sample project
We provided a sample project for playing around and seeing how it works.
Getting started:
# navigate to the sample-project folder
$ cd sample-project
# Build and start the containers:
$ docker-compose up
Querying logs
Make sure you are in the sample-project folder
Calling a few tasks
$ docker-compose exec celeryd python call_tasks.py
Tasks have been called!
Run `docker-compose logs -f celery-logger` to see the logger in action.
Taking a look in all events
$ docker-compose logs celery-logger
Searching for failed tasks:
$ docker-compose logs celery-logger | grep task-failed
Searching for a specific task:
$ docker-compose logs celery-logger | grep "app.add"
Searching for a specific task and args:
$ docker-compose logs celery-logger | grep "app.add" | grep "(6, 1)"
Searching for a task id
$ docker-compose logs celery-logger | grep 20925a8c-03f7-4bd7-b3dd-24e2bc9e26e2
Installation
Use the package manager pip to install celery-logger.
pip install celerylogger
Usage
The executable will be available in the path as celery-logger
:
# Display the help text
$ celery-logger -h
# Start logging from a redis broker
$ celery-logger --celery-broker redis://redis:6379/0
Authors
- Sergio Oliveira - Initial work - Seocam
- Thiago Ferreira - Improvements, documentation and current maintainer - thiagoferreiraw
- André Girol - Packaging and distribution - Girol
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for celery_logger-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 92ef506e6ffd274d3393be3b8a1c9090842a6487b04a77f5f4987844ab44ba1d |
|
MD5 | 8b4526309c4680078070d22f246aa8b8 |
|
BLAKE2b-256 | 8357d5fd3250d2750c3bc87b17e96fe461697b16007851032d04ac2534c76e59 |