django-user-tasks is a reusable Django application for managing user-triggered asynchronous tasks. It provides a status page for each such task, which includes a meaningful progress indicator if the task is currently being executed and provides any appropriate text and/or links for output once the task is complete.
In Open edX, such tasks include operations such as exporting or importing a course, sending an email to all the students in a course, uploading a video, and other tasks which often take too long to perform during a single web request (as outlined in OEP-3). However, this has been written with the intention of being useful in a variety of Django projects outside the Open edX platform as well.
Note that this library was created as a consolidation of lessons learned from implementing such tasks in various parts of the Open edX code base. They don’t yet all use this library, but the plan is to over time refactor many of them to do so.
Overview
django-user-tasks is currently a wrapper for Celery (although the hope is that it could also be extended to also support channels and other asynchronous task queues). By extending the provided UserTask class (or adding UserTaskMixin to an existing Task subclass) and providing a user_id task argument, the task’s status is stored in a database table separate from the Celery broker and result store. This UserTaskStatus model allows for full database queries of the tasks that users are most likely to care about while not imposing any restrictions on the Celery configuration most appropriate for the site’s overall needs for asynchronous task processing.
Most of the status updating is handled automatically via Celery’s signals mechanism, but it can be enhanced by:
Overriding the UserTaskMixin methods such as generate_name and calculate_total_steps for particular types of tasks
Calling some of the UserTaskStatus methods like increment_completed_steps and set_state from the task implementation
Saving task output as instances of the UserTaskArtifact model
Documentation
The full documentation is at https://django-user-tasks.readthedocs.org.
License
The code in this repository is licensed under the Apache Software License 2.0 unless otherwise noted.
Please see LICENSE.txt for details.
How To Contribute
Contributions are very welcome.
Please read How To Contribute for details.
Even though they were written with edx-platform in mind, the guidelines should be followed for Open edX code in general.
Reporting Security Issues
Please do not report security issues in public. Please email security@edx.org.
Getting Help
Have a question about this repository, or about Open edX in general? Please refer to this list of resources if you need any assistance.
Change Log
Unreleased
[0.1.4] - 2017-01-30
Changed
Slightly improved handling of tasks which start before their status records are committed (due to database transactions). Also documented how to avoid this problem in the first place.
[0.1.3] - 2017-01-03
Changed
Tasks which were explicitly canceled, failed, or retried no longer have their status changed to Succeeded just because the task exited cleanly.
Celery tasks which fail to import cleanly by name (because they use a custom name which isn’t actually the fully qualified task name) are now just ignored in the before_task_publish signal handler.
[0.1.2] - 2016-12-05
Changed
Add a migration to explicitly reference the setting for artifact file storage. This setting is likely to vary between installations, but doesn’t affect the generated database schema. This change should prevent makemigrations from creating a new migration whenever the setting value changes.
[0.1.1] - 2016-10-11
Changed
Fix Travis configuration for PyPI deployments.
Switch from the Read the Docs Sphinx theme to the Open edX one for documentation.
[0.1.0] - 2016-10-07
Added
First attempt to release on PyPI.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file django-user-tasks-0.1.4.tar.gz.
File metadata
- Download URL: django-user-tasks-0.1.4.tar.gz
- Upload date:
- Size: 22.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1de4be8664a2c0bd192489b1db9df1c23fd7e7b7e0a2b356c07b4ad5f5f7b0eb
|
|
| MD5 |
a53e2bff028ed22e807cd7c74300e3da
|
|
| BLAKE2b-256 |
b20af9900bcf505400c83d4462e4114217a42aadb239275f475aefd52362500d
|
File details
Details for the file django_user_tasks-0.1.4-py2.py3-none-any.whl.
File metadata
- Download URL: django_user_tasks-0.1.4-py2.py3-none-any.whl
- Upload date:
- Size: 24.3 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d132acd4d23b6a133625f095122d71f847c52297e05d6c9f62230fabb31be3d1
|
|
| MD5 |
8bc50ac7da5057fbdff9eddb91eca319
|
|
| BLAKE2b-256 |
ef5bc1b1213f1267efdea2ebd23995a651d963b71dae90ec7fb4d71516ed7470
|
