Skip to main content

Various goodies for Apache Airflow

Project description

Airgoodies

GitHub Actions Workflow Status GitHub Actions Workflow Status PyPI - Version GitHub License PyPI - Downloads GitHub contributors

Airgoodies is a project that contains various APIs to interact with external services inside Apache Airflow using minimum configuration (see airgoodies.{module}.variables.json for each module).

Current version matrix:

Airgoodies Version Apache Airflow Version Python Version Project tag
0.0.4 2.7.2 3.11 v0.0.4
0.0.3 2.7.2 3.11 v0.0.3
0.0.2 2.7.2 3.11 v0.0.2
0.0.1-alpha 2.7.2 3.11 v0.0.1-alpha

Provided goodies for version 0.0.4:

Module Description Dependency Versions
airgoodies.command API for dynamic task configuration through YAML pyyaml==6.0.1
airgoodies.aws API for easy interaction with AWS pandas==2.1.1
apache-airflow-providers-amazon===8.7.1
airgoodies.mongo API for easy interaction with MongoDB pymongo==4.5.0
airgoodies.xcom API for managing variables through XCom None

Installation

Add the following requirement in your requirements.txt

# requirements.txt
airgoodies=0.0.4

Example usage

For the official documentation, see here

For an example of how to use this project, see here

Building the project

To build the project:

$ python3 setup.py sdist bdist_wheel

License

This project is available under the MIT License.

Author

Stavros Grigoriou (stav121)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

airgoodies-0.0.4.tar.gz (11.2 kB view details)

Uploaded Source

Built Distribution

airgoodies-0.0.4-py3-none-any.whl (15.5 kB view details)

Uploaded Python 3

File details

Details for the file airgoodies-0.0.4.tar.gz.

File metadata

  • Download URL: airgoodies-0.0.4.tar.gz
  • Upload date:
  • Size: 11.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for airgoodies-0.0.4.tar.gz
Algorithm Hash digest
SHA256 da74141b7488cd030823e05f7563b27c59f1b1e62b92e61825d71803ad3dc40a
MD5 8744a90ed90e9a16488667eddd8e4d28
BLAKE2b-256 7bdd708251ad5a5e7b3878dcc6ea7eedc79fadd3298d34e18ffad33888f5b46b

See more details on using hashes here.

File details

Details for the file airgoodies-0.0.4-py3-none-any.whl.

File metadata

  • Download URL: airgoodies-0.0.4-py3-none-any.whl
  • Upload date:
  • Size: 15.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.6

File hashes

Hashes for airgoodies-0.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 974587de4c9edc9b092b757f6781e0f0d9f04fc49597d0ede705c93b3f6cb708
MD5 f443421ff36c4004fffd114a70c05f0a
BLAKE2b-256 4375a7c0029f0a2442048654e677a8231513985a5a9291b50be722e1d66d49d0

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page