Various goodies for Apache Airflow
Project description
Airgoodies
Airgoodies is a project that contains various APIs to interact with external services inside Apache Airflow using
minimum configuration (see airgoodies.{module}.variables.json
for each module).
Current version matrix:
Airgoodies Version | Apache Airflow Version | Python Version | Project tag |
---|---|---|---|
0.0.4 | 2.7.2 | 3.11 | v0.0.4 |
0.0.3 | 2.7.2 | 3.11 | v0.0.3 |
0.0.2 | 2.7.2 | 3.11 | v0.0.2 |
0.0.1-alpha | 2.7.2 | 3.11 | v0.0.1-alpha |
Provided goodies for version 0.0.4:
Module | Description | Dependency Versions |
---|---|---|
airgoodies.command | API for dynamic task configuration through YAML | pyyaml==6.0.1 |
airgoodies.aws | API for easy interaction with AWS | pandas==2.1.1 apache-airflow-providers-amazon===8.7.1 |
airgoodies.mongo | API for easy interaction with MongoDB | pymongo==4.5.0 |
airgoodies.xcom | API for managing variables through XCom | None |
Installation
Add the following requirement in your requirements.txt
# requirements.txt
airgoodies=0.0.4
Example usage
For the official documentation, see here
For an example of how to use this project, see here
Building the project
To build the project:
$ python3 setup.py sdist bdist_wheel
License
This project is available under the MIT License.
Author
Stavros Grigoriou (stav121)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file airgoodies-0.0.4.tar.gz
.
File metadata
- Download URL: airgoodies-0.0.4.tar.gz
- Upload date:
- Size: 11.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | da74141b7488cd030823e05f7563b27c59f1b1e62b92e61825d71803ad3dc40a |
|
MD5 | 8744a90ed90e9a16488667eddd8e4d28 |
|
BLAKE2b-256 | 7bdd708251ad5a5e7b3878dcc6ea7eedc79fadd3298d34e18ffad33888f5b46b |
File details
Details for the file airgoodies-0.0.4-py3-none-any.whl
.
File metadata
- Download URL: airgoodies-0.0.4-py3-none-any.whl
- Upload date:
- Size: 15.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.6
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 974587de4c9edc9b092b757f6781e0f0d9f04fc49597d0ede705c93b3f6cb708 |
|
MD5 | f443421ff36c4004fffd114a70c05f0a |
|
BLAKE2b-256 | 4375a7c0029f0a2442048654e677a8231513985a5a9291b50be722e1d66d49d0 |