TaskHawk is a replacement for celery that works on AWS SQS/SNS and Google PubSub, while keeping things pretty simple and straightforward. Any unbound function can be converted into a TaskHawk task.
Only Python 3.6+ is supported currently.
You can find the latest, most up to date, documentation at Read the Docs.
Quick Start
First, install the library:
$ pip install taskhawkNext, set up a few configuration settings:
Common required settings:
TASKHAWK_QUEUE = "DEV-MYAPP"When using AWS, additional required settings are:
AWS_ACCESS_KEY = <YOUR AWS KEY>
AWS_ACCOUNT_ID = <YOUR AWS ACCOUNT ID>
AWS_REGION = <YOUR AWS REGION>
AWS_SECRET_KEY = <YOUR AWS SECRET KEY>
TASKHAWK_CONSUMER_BACKEND = 'taskhawk.backends.aws.AWSSQSConsumerBackend'
TASKHAWK_PUBLISHER_BACKEND = 'taskhawk.backends.aws.AWSSNSPublisherBackend'In case of GCP, additional required settings are:
TASKHAWK_CONSUMER_BACKEND = 'taskhawk.backends.gcp.GooglePubSubConsumerBackend'
TASKHAWK_PUBLISHER_BACKEND = 'taskhawk.backends.gcp.GooglePubSubPublisherBackend'If running outside Google Cloud (e.g. locally), set GOOGLE_APPLICATION_CREDENTIALS.
Within Google Cloud, these credentials and permissions are managed by Google using IAM.
If the Pub/Sub resources lie in a different project, set GOOGLE_CLOUD_PROJECT to the project id.
For Django projects, simple use Django settings to configure Taskhawk. For Flask projects, use Flask config. For other frameworks, you can either declare an environment variable called SETTINGS_MODULE that points to a module where settings may be found, or manually configure using taskhawk.conf.settings.configure_with_object.
Then, simply add the decorator taskhawk.task to your function:
@taskhawk.task
def send_email(to: str, subject: str, from_email: str = None) -> None:
# send emailAnd finally, dispatch your function asynchronously:
send_email.dispatch('example@email.com', 'Hello!', from_email='example@spammer.com')Development
Getting Started
Assuming that you have Python, pyenv and pyenv-virtualenv installed, set up your environment and install the required dependencies like this instead of the pip install taskhawk defined above:
$ git clone https://github.com/cloudchacho/taskhawk-python.git
$ cd taskhawk-python
$ pyenv virtualenv 3.7.7 taskhawk-python-3.7
...
$ pyenv activate taskhawk-python-3.7
$ pip install -r requirements/dev-3.7.txtRunning Tests
You can run tests in using make test. By default, it will run all of the unit and functional tests, but you can also specify your own py.test options.
$ py.test
$ py.test tests/test_consumer.pyGenerating Documentation
Sphinx is used for documentation. You can generate HTML locally with the following:
$ pip install -e .[dev]
$ make docsGetting Help
We use GitHub issues for tracking bugs and feature requests.
If it turns out that you may have found a bug, please open an issue
4 maintainers
Release files for taskhawk 4.7.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| taskhawk-4.7.0.tar.gz | 39.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| taskhawk-4.7.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 69.9 kB
Release files / taskhawk-4.7.0.tar.gz
| Download URL | taskhawk-4.7.0.tar.gz |
|---|---|
| Size | 39.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
54923eff9b4702fee6ed00dc5a63aade34699a44cd9b1e4c20179c92b686187d
|
|
BLAKE2b-256 checksum How to use checksums |
2a017ff1b2aecb76b51d3c42baa619cfe195bc056c94d1b66be7e8c9f553088b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.9.14
|
Release files / taskhawk-4.7.0-py3-none-any.whl
| Download URL | taskhawk-4.7.0-py3-none-any.whl |
|---|---|
| Size | 30.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7ce2180ff8eaedbf3c2da78f4ce64de7c3abc9a0c70da666b6a50851a22a0203
|
|
BLAKE2b-256 checksum How to use checksums |
6c107430897f77a02ade9057fa3b3d502ba0aaa84065335975d3b2851c8890e7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.9.14
|
