Skip to main content

Pipeline to Aggregate Data for Optimised Cloud Capabilities

Project description

PADOCC Package

PyPI version

Padocc (Pipeline to Aggregate Data for Optimal Cloud Capabilities) is a Data Aggregation pipeline for creating Kerchunk (or alternative) files to represent various datasets in different original formats. Currently the Pipeline supports writing JSON/Parquet Kerchunk files for input NetCDF/HDF files. Further developments will allow GeoTiff, GRIB and possibly MetOffice (.pp) files to be represented, as well as using the Pangeo Rechunker tool to create Zarr stores for Kerchunk-incompatible datasets.

Example Notebooks at this link

Documentation hosted at this link

Kerchunk Pipeline

Release 1.4.4

Release date: 22nd January 2026

See the release notes for details.

This package acknowledges contributions by Matt Brown as a pre-release tester.

Installation

To install this package, clone the repository using git clone, then follow the steps below to install the package with the necessary dependencies.

python -m venv .venv
source .venv/bin/activate
pip install poetry
poetry install

Usage

Please refer to the documentation pages linked above for exact specifications on how to effectively use PADOCC.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

padocc-1.4.5.tar.gz (9.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

padocc-1.4.5-py3-none-any.whl (10.0 MB view details)

Uploaded Python 3

File details

Details for the file padocc-1.4.5.tar.gz.

File metadata

  • Download URL: padocc-1.4.5.tar.gz
  • Upload date:
  • Size: 9.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.9 Linux/5.14.0-611.24.1.el9_7.x86_64

File hashes

Hashes for padocc-1.4.5.tar.gz
Algorithm Hash digest
SHA256 092cbcd7051fbf429bac15618e7ff8a8b49139790e9a335cf4c9f06853fa5d91
MD5 01358e6b57c9a5baeb76b430a83ce9ce
BLAKE2b-256 070029ce451eeff23ebbb4662869a2e03b9a71580988f64bb17fb6516fabe85b

See more details on using hashes here.

File details

Details for the file padocc-1.4.5-py3-none-any.whl.

File metadata

  • Download URL: padocc-1.4.5-py3-none-any.whl
  • Upload date:
  • Size: 10.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.9 Linux/5.14.0-611.24.1.el9_7.x86_64

File hashes

Hashes for padocc-1.4.5-py3-none-any.whl
Algorithm Hash digest
SHA256 6f94cac0adfa1741cdba13a5456a2266698467a1cc0d2cba740275602b9e1145
MD5 662ef99a7d0f742b3fe7ccd2c51d98f6
BLAKE2b-256 0aca9075c5cbf1cd2d21e2d02a584b08fe8be7bcb802e534f4c900c4efc8da13

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page