Skip to main content

No project description provided

Project description

airflow-docker-compose

CircleCI codecov

Description

A reasonably light wrapper around docker-compose to make it simple to start a local airflow instance in docker.

Usage

airflow-docker-compose --help
airflow-docker-compose up

Configuration

In order to use this tool, you should have a local dags folder containing your dags. You should also have a pyproject.toml file which minimally looks like

[tool.airflow-docker-compose]
docker-network = 'network-name'

In order to set airflow configuration, you can use the airflow-environment-variables key. This allows you to set any airflow.cfg variables like so:

[tool.airflow-docker-compose]
airflow-environment-variables = {
    AIRWFLOW_WORKER_COUNT = 4
    AIRFLOW__AIRFLOWDOCKER__FORCE_PULL = 'false'
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

airflow-docker-compose-0.1.5.tar.gz (13.8 kB view hashes)

Uploaded Source

Built Distribution

airflow_docker_compose-0.1.5-py3-none-any.whl (15.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page