Documentation: https://taskiq-python.github.io/
What is taskiq?
Taskiq is an asynchronous distributed task queue for python. This project takes inspiration from big projects such as Celery and Dramatiq. But taskiq can send and run both the sync and async functions, has integration with popular async frameworks, such as FastAPI and AioHTTP.
Also, we use PEP-612 to provide the best autosuggestions possible. All code is type-hinted.
Installation
This project can be installed using pip:
pip install taskiq
Or it can be installed directly from git:
pip install git+https://github.com/taskiq-python/taskiq
Usage
At first you need to create a broker. Broker is an object that can communicate to workers using distributed queues.
We have different brokers for different queue backends. For example, we have a broker for NATS, Redis, RabbitMQ, Kafka and even more. Choose the one that fits you and create an instance.
from taskiq_nats import JetStreamBroker
broker = JetStreamBroker("nats://localhost:4222", queue="my_queue")
Declaring tasks is as easy as declaring a function. Just add a decorator to your function and you are ready to go.
import asyncio
from taskiq_nats import JetStreamBroker
broker = JetStreamBroker("nats://localhost:4222", queue="my_queue2")
@broker.task
async def my_task(a: int, b: int) -> None:
print("AB", a + b)
async def main():
await broker.startup()
await my_task.kiq(1, 2)
await broker.shutdown()
if __name__ == "__main__":
asyncio.run(main())
The message is going to be sent to the broker and then to the worker. The worker will execute the function. To start worker processes, just run the following command:
taskiq worker path.to.the.module:broker
Where path.to.the.module is the path to the module where the broker is defined and broker is the name of the broker variable.
If you have tasks in different modules, you can ask taskiq to automatically import them by passing the --fs-discover flag:
taskiq worker path.to.the.module:broker --fs-discover
It will import all modules called tasks.py in the current directory and all subdirectories.
Also, we support hot reload for workers. To enable it, just pass the --reload flag. It will reload the worker when the code changes (To use it, install taskiq with reload extra. E.g pip install taskiq[reload]).
Also, we have cool integrations with popular async frameworks. For example, we have an integration with FastAPI or AioHTTP. You can use it to reuse dependencies from your web app in your tasks.
Read about all features in our documentation: https://taskiq-python.github.io/
Local development
Linting
We use pre-commit to do linting locally.
After cloning this project, please install pre-commit. It helps fix files before committing changes.
pre-commit install
Testing
Pytest can run without any additional actions or options.
pytest
Docs
To run docs locally, you need to install yarn.
First, you need to install dependencies.
yarn install
After that you can set up a docs server by running:
yarn docs:dev
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file taskiq-0.12.5.tar.gz.
File metadata
- Download URL: taskiq-0.12.5.tar.gz
- Upload date:
- Size: 407.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fbdfc949fdefe746f771195faa34769fa6dbbb109cbd41cb1d056b794f933f43
|
|
| MD5 |
fa5e191cf47e292aef09826fdfe4cd6f
|
|
| BLAKE2b-256 |
e4687b3c557782af291e22b26479127f287520fdf066d4684838e1bdd146cdc0
|
File details
Details for the file taskiq-0.12.5-py3-none-any.whl.
File metadata
- Download URL: taskiq-0.12.5-py3-none-any.whl
- Upload date:
- Size: 94.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.12.5 {"installer":{"name":"uv","version":"0.12.5","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3937969fcb5290d1a007e068e7af45d0a44f885e3bfe4bf1860f7e81794930f8
|
|
| MD5 |
0c43414b1a61772d3aca8263e6dde8dd
|
|
| BLAKE2b-256 |
0a4bc37a3cdfaff2ff53c3ca5d5289636b42141c9964f67d16df3017a97be9c6
|
