Airflow Memray
Memory profiling for Airflow with Memray.
Configuration Reference
This section contains the list of all the available Airflow Memray configurations that you can set in airflow.cfg file or using environment variables.
base_folder
The base folder under which Airflow Memray will store profiling results. Possible values can be anything what is supported by Airflow Object Storage.
If it refers to a local file system path, then it must be accessible by the task and the webserver.
Default: "file:///tmp/airflow/memray"
Environment Variable: AIRFLOW__MEMRAY__BASE_FOLDER
storage_conn_id
The Airflow Connection to use if base_folder is set to a remote cloud storage location.
Default: None
Environment Variable: AIRFLOW__MEMRAY__STORAGE_CONN_ID
tasks
The tasks to be profiled as a comma separated list of wildcard pattern as implemented by the fnmatch module. The pattern are applied against the full task ID in the form <dag_id>.<task_id>.
Set it to "*" to profile all tasks.
Default: ""
Environment Variable: AIRFLOW__MEMRAY__TASKS
Airflow Summit 2024
I have given a presentation about this package at Airflow Summit 2024.
You can visit the official page of the presentation or directly watch video on YouTube by clicking on the following picture:
1 maintainer
Metadata
1 maintainer
Release files for airflow-memray 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| airflow_memray-0.1.1.tar.gz | 10.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| airflow_memray-0.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 21.7 kB
Release files / airflow_memray-0.1.1.tar.gz
| Download URL | airflow_memray-0.1.1.tar.gz |
|---|---|
| Size | 10.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bbee704a376c08b7a20d0a4b7bbb917fdae43b8b8d2b20a5ea2100a03e894cc5
|
|
BLAKE2b-256 checksum How to use checksums |
5ed3227c0e18a2548e3231cf3fb77b8633b5161f3e55beb1a700e6e11d949f66
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 12, 2025.
Transparency logRelease files / airflow_memray-0.1.1-py3-none-any.whl
| Download URL | airflow_memray-0.1.1-py3-none-any.whl |
|---|---|
| Size | 11.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a049c0f13fc021e283b6e3ad78784985da55e894c51700d5fcfbaa8daaab91b4
|
|
BLAKE2b-256 checksum How to use checksums |
ed4bcacfd98bb1087be5c7eb3066ad17e3effee8498ec09226df35705b4e96bb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Apr 12, 2025.
Transparency log
