Skip to main content

Pancham Data Pipelines

Github Actions Quality Gate Status

Pancham simplifies the process of reading and processing data with Pandas.

What is it for

A common scenario in data migration projects is to need to take exports from one system, apply some transformation rules and write the data somewhere else. This could be files, a database or an API. All of this can be done with Pandas but we would need to write a lot of code, Pancham is here to make that process easier.

flowchart LR;
    s[Source Files]-->t[Transformation];
    t-->o[Output Files];

Key features

  • Load files
  • Rename fields
  • Validate data types and not-null columns
  • Apply python functions to transform values
  • Return data as a Pandas DataFrame
  • Write data to a database

Supported Source Files

  • Excel
  • SQL
  • YAML
  • CSV
  • JSON

Supported Output

  • SQL
  • CSV

Additional sources and output formats will be added with time.

Usage

The most common approach is to use a mapping file.

name: example
file_type: yaml
file_path: source/customer.yml
key: customer
output:
  - table: customers
    output_type: database
fields:
  - name: id
    source_name: customer_id
    field_type: str
    nullable: false
  - name: status
    source_name: account_status
    field_type: str
    nullable: false

This simple mapping file expects to be able to load a source file called customer.yml with the following content:

customer:
    - customer_id: 123
      account_status: active
    - customer_id: 456
      account_status: on_hold

The pipeline wll read the input file and populate a database that you can then query.

The final part is the pancham configuration.

Metadata

Release files for pancham 0.28.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pancham 0.28.2
File Size Uploaded Provenance Actions
pancham-0.28.2.tar.gz 65.5 kB With provenance Details for pancham-0.28.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for pancham 0.28.2
File Interpreter ABI Platform Actions
pancham-0.28.2-py3-none-any.whl Python 3 none any Details for pancham-0.28.2-py3-none-any.whl

Total release size: 174.3 kB

Release files / pancham-0.28.2.tar.gz

Download URL pancham-0.28.2.tar.gz
Size 65.5 kB
Tags Source
SHA-256 checksum
How to use checksums
c1bd0c86466a84a3bd566ff773c322cd8a47ccaa2b6e8386717e4cb2732f35ee
BLAKE2b-256 checksum
How to use checksums
47d5b1493b4682dc187f069cdf7ae96728d8d0f1f3b628a00239075c56bcc886
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.12.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 28, 2025.

Transparency log

Release files / pancham-0.28.2-py3-none-any.whl

Download URL pancham-0.28.2-py3-none-any.whl
Size 108.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e7ce675bb1e53c547240fc3379891de1aaa02153897ca4e31a37dd3b32f8862b
BLAKE2b-256 checksum
How to use checksums
f64c2a5b9755e5b53db2a7d18f7b91f2fdc824b847e5219b096717fa9c7e495a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.12.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 28, 2025.

Transparency log

Security for pancham 0.28.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for pancham-0.28.2.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 28, 2025.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.28.2 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page