Skip to main content

`recoverable-async-task` is a Python library that streamlines the handling of asynchronous tasks through its `RecoverableAsyncTask` class, with the added benefit of **supporting task checkpointing and resumption**. This feature ensures that tasks can pick up from where they left off in the event of unexpected failures.

Project description

recoverable-async-task: An Asynchronous Task Processing Library

中文文档 | English

recoverable-async-task is a Python library that streamlines the handling of asynchronous tasks through its RecoverableAsyncTask class, with the added benefit of supporting task checkpointing and resumption. This feature ensures that tasks can pick up from where they left off in the event of unexpected failures.

Quick Start Guide

To install the library, use the following command:

pip install recoverable-async-task

The example.py file provides a simple illustration of how to utilize the RecoverableAsyncTask library to manage concurrent tasks and enable checkpointing and resumption:

python3 example.py

You may notice that even with retry_n=3 set, some tasks may still fail due to random issues. In such cases, you can simply execute the tasks again, and they will automatically read the checkpoint file and resume from where they were interrupted. You can repeat this process manually or programmatically until all tasks are successfully completed.

Contributing Guidelines

If you wish to contribute to the recoverable-async-task library, please follow the setup instructions below to prepare your development environment:

source dev-setup.sh

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

recoverable_async_task-0.1.1.tar.gz (4.4 kB view hashes)

Uploaded Source

Built Distribution

recoverable_async_task-0.1.1-py3-none-any.whl (4.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page