Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and chunk aspect ratio
Project description
# dynamic_chunks
Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and ‘chunk aspect ratio’
The chunk aspect ratio describes the amount of chunks along a given dimension. Take a dataset with two dimensions (a and b). A chunk aspect ratio {‘a’:2, ‘b’:1} means that the number of total chunks along b is twice that of b. This concept was inspired by a discussion with [Rich Signell](https://github.com/rsignell-usgs) at Scipy ‘23. The idea is that one might want to optimize the chunking of a dataset to make e.g. an operation along time n times slower than an operation along spatial dimensions.
## Useage TBW
## Developer Guide
Set up your development environment with conda:
` conda create --name dynamic_rechunking python=3.10 pip conda activate dynamic_rechunking pip install -e ".[test]" `
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for dynamic_chunks-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5516d4878e04f523db334f62c3a3ca2c364420d012e3a18cfaa20176dc4b0097 |
|
MD5 | 57eee07de9d8e11fbccfc94618d15316 |
|
BLAKE2b-256 | 64a93387ef818b1376b01352ab36c46bb4446233a582ae10b32dbd055e2a17ca |