Skip to main content

Provider package apache-airflow-providers-edge3 for Apache Airflow

Project description

Package apache-airflow-providers-edge3

Release: 4.2.0

Handle edge workers on remote sites via HTTP(s) connection and orchestrates work over distributed sites.

When tasks need to be executed on remote sites where the connection need to pass through firewalls or other network restrictions, the Edge Worker can be deployed. The Edge Worker is a lightweight process with reduced dependencies. The worker only needs to be able to communicate with the central Airflow site via HTTPS.

In the central Airflow site the EdgeExecutor is used to orchestrate the work. The EdgeExecutor is a custom executor which is used to schedule tasks on the edge workers. The EdgeExecutor can co-exist with other executors (for example CeleryExecutor or KubernetesExecutor) in the same Airflow site.

Additional REST API endpoints are provided to distribute tasks and manage the edge workers. The endpoints are provided by the API server.

Provider package

This is a provider package for edge3 provider. All classes for this provider package are in airflow.providers.edge3 python package.

You can find package information and changelog for the provider in the documentation.

Installation

You can install this package on top of an existing Airflow installation (see Requirements below for the minimum Airflow version supported) via pip install apache-airflow-providers-edge3

The package supports the following python versions: 3.10,3.11,3.12,3.13,3.14

Requirements

PIP package

Version required

apache-airflow

>=3.0.0,!=3.1.0

apache-airflow-providers-common-compat

>=1.15.0

pydantic

>=2.11.0

retryhttp

>=1.4.0

aiofiles

>=23.2.0

aiohttp

>=3.14.0

The changelog for the provider package can be found in the changelog.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

apache_airflow_providers_edge3-4.2.0.tar.gz (677.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

apache_airflow_providers_edge3-4.2.0-py3-none-any.whl (464.0 kB view details)

Uploaded Python 3

File details

Details for the file apache_airflow_providers_edge3-4.2.0.tar.gz.

File metadata

File hashes

Hashes for apache_airflow_providers_edge3-4.2.0.tar.gz
Algorithm Hash digest
SHA256 7b97250c92290729bc24fdfa2959c424dd7e4a838c7bf96931d367d3224d21ad
MD5 fb11c0ea3d16a2c7db57a5de485c3d30
BLAKE2b-256 bd9927f0331db0d501d6b31358bddfcb11dd9c71a1fb85aaa2f0545c47c934d5

See more details on using hashes here.

File details

Details for the file apache_airflow_providers_edge3-4.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for apache_airflow_providers_edge3-4.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6c09e886f094707fc72da4f68a2c75c8d44173af793deb323da13c3ffbbf02ec
MD5 d9c496c76145fea5ed0f984881121642
BLAKE2b-256 a826cba0f6433ccacd0eafa62993008c467a90f4d88598341f4162568bfb06a8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page