Pancham Data Pipelines
Pancham simplifies the process of reading and processing data with Pandas.
What is it for
A common scenario in data migration projects is to need to take exports from one system, apply some transformation rules and write the data somewhere else. This could be files, a database or an API. All of this can be done with Pandas but we would need to write a lot of code, Pancham is here to make that process easier.
flowchart LR;
s[Source Files]-->t[Transformation];
t-->o[Output Files];
Key features
- Load files
- Rename fields
- Validate data types and not-null columns
- Apply python functions to transform values
- Return data as a Pandas DataFrame
- Write data to a database
Supported Source Files
- Excel
- SQL
- YAML
- CSV
- JSON
Supported Output
- SQL
- CSV
Additional sources and output formats will be added with time.
Usage
The most common approach is to use a mapping file.
name: example
file_type: yaml
file_path: source/customer.yml
key: customer
output:
- table: customers
output_type: database
fields:
- name: id
source_name: customer_id
field_type: str
nullable: false
- name: status
source_name: account_status
field_type: str
nullable: false
This simple mapping file expects to be able to load a source file called customer.yml with the following content:
customer:
- customer_id: 123
account_status: active
- customer_id: 456
account_status: on_hold
The pipeline wll read the input file and populate a database that you can then query.
The final part is the pancham configuration.
1 maintainer
Metadata
1 maintainer
Release files for pancham 0.29.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pancham-0.29.0.tar.gz | 68.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pancham-0.29.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 180.7 kB
Release files / pancham-0.29.0.tar.gz
| Download URL | pancham-0.29.0.tar.gz |
|---|---|
| Size | 68.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
cd801d61c110450052c71c8311729b18520a7043f74d49301084efa2b2a50c17
|
|
BLAKE2b-256 checksum How to use checksums |
0880de59289b270cf3ef307d98fa52f3acf2d5745822a215040c23a49edb53b8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 3, 2025.
Transparency logRelease files / pancham-0.29.0-py3-none-any.whl
| Download URL | pancham-0.29.0-py3-none-any.whl |
|---|---|
| Size | 112.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
698769b0c5aa628a75298dc6cd48ef136bf95068b8494ea7304f87c3a2878487
|
|
BLAKE2b-256 checksum How to use checksums |
ea6eb2b67356de86b6e15ba982a337ffb5a06b796e0b14764ed691b97a87c0d4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
PyPI Publish Attestation
PyPI verified that this artifact, at this checksum, originated from the publisher listed below.
Signed by GitHub Actions, verified by PyPI on Sep 3, 2025.
Transparency log
