Skip to main content

Pipeline to Aggregate Data for Optimised Cloud Capabilities

Project description

PADOCC Package

PyPI version

Padocc (Pipeline to Aggregate Data for Optimal Cloud Capabilities) is a Data Aggregation pipeline for creating Kerchunk (or alternative) files to represent various datasets in different original formats. Currently the Pipeline supports writing JSON/Parquet Kerchunk files for input NetCDF/HDF files. Further developments will allow GeoTiff, GRIB and possibly MetOffice (.pp) files to be represented, as well as using the Pangeo Rechunker tool to create Zarr stores for Kerchunk-incompatible datasets.

Example Notebooks at this link

Documentation hosted at this link

Kerchunk Pipeline

Release 1.4.4

Release date: 22nd January 2026

See the release notes for details.

This package acknowledges contributions by Matt Brown as a pre-release tester.

Installation

To install this package, clone the repository using git clone, then follow the steps below to install the package with the necessary dependencies.

python -m venv .venv
source .venv/bin/activate
pip install poetry
poetry install

Usage

Please refer to the documentation pages linked above for exact specifications on how to effectively use PADOCC.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

padocc-1.4.4.tar.gz (9.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

padocc-1.4.4-py3-none-any.whl (10.0 MB view details)

Uploaded Python 3

File details

Details for the file padocc-1.4.4.tar.gz.

File metadata

  • Download URL: padocc-1.4.4.tar.gz
  • Upload date:
  • Size: 9.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.9 Linux/5.14.0-570.55.1.el9_6.x86_64

File hashes

Hashes for padocc-1.4.4.tar.gz
Algorithm Hash digest
SHA256 4044574cda892548a8c1677f84ba000c52eca5b8a23a35d056b30d83b41cab2f
MD5 eb409492c6d41c058a331799d469d4c6
BLAKE2b-256 8a95305e805e68045e89716bfea6d897bdbb3a85da47298e6bfdf8c7c1a5abb6

See more details on using hashes here.

File details

Details for the file padocc-1.4.4-py3-none-any.whl.

File metadata

  • Download URL: padocc-1.4.4-py3-none-any.whl
  • Upload date:
  • Size: 10.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.9 Linux/5.14.0-570.55.1.el9_6.x86_64

File hashes

Hashes for padocc-1.4.4-py3-none-any.whl
Algorithm Hash digest
SHA256 0c114fd0bd3b670213d846ff5ffa5a0a0832d1008e82531915199b63175356a9
MD5 e6b188d6e3458d122ba82525faf6f63b
BLAKE2b-256 cfc755379b5d4cd05e2b80a433c7d4e10c0d129193211385b2515f6a9b72b29b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page