pipera
Declarative platform for file-drop ingest and report delivery on Apache Airflow.
Two jobs that most data teams rebuild by hand every month:
- File-drop ingest — a vendor drops files (csv, fixed-width, zip, gpg, with control files) on SFTP, S3 or Blob storage. Something has to find them, verify they are complete, load them into the lake, copy them onward, avoid double loading, support backfills, and raise an alert when a file never arrives.
- Report delivery — query, transform, produce a well formatted Excel or CSV, and deliver it to SharePoint, Drive, email or chat on a schedule, with an SLA and an audit trail of who received what.
pipera lets you declare both in YAML, deploy them through git, and generate the Airflow DAGs from that declaration. It runs on the Airflow you already have rather than asking you to adopt a new orchestrator.
Status
Version 0.0.0 is a placeholder reserving the name. There is no working code yet. The first usable release is planned as 0.1.0.
License
Apache-2.0
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pipera-0.0.0.tar.gz.
File metadata
- Download URL: pipera-0.0.0.tar.gz
- Upload date:
- Size: 5.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7736222bdaf4de410845038c9937830d19265755484bd16547f8546e715d6f6d
|
|
| MD5 |
b864c4822d722b7a74a67e29aea2fc1e
|
|
| BLAKE2b-256 |
5bcce98eeb1114b85f3b65533f527e78a6c515a06db56b27cbd2348823a5afa3
|
File details
Details for the file pipera-0.0.0-py3-none-any.whl.
File metadata
- Download URL: pipera-0.0.0-py3-none-any.whl
- Upload date:
- Size: 6.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.12.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7d0336e1c3ff7048397266f1acb387da3f7b0a41ffd4995bfce55bd3a1852de4
|
|
| MD5 |
acf1744b9d69f127a359ea3fffd51b90
|
|
| BLAKE2b-256 |
0cc6db474aad9315efcd2155c852d5a332c48a356b4ace50560e70bc39325ecb
|
