cfdb
CF conventions multi-dimensional array storage on top of Booklet
Documentation: https://mullenkamp.github.io/cfdb/
Source Code: https://github.com/mullenkamp/cfdb
cfdb is a pure Python database for managing labeled multi-dimensional arrays following the CF conventions. It is an alternative to netCDF4/xarray, built on Booklet for local file storage and EBooklet for S3 sync. Thread-safe and multiprocessing-safe via locks.
Installation
pip install cfdb
Quick Example
import cfdb
import numpy as np
with cfdb.open_dataset('example.cfdb', flag='n') as ds:
lat = ds.create.coord.lat(data=np.linspace(-90, 90, 181, dtype='float32'))
lon = ds.create.coord.lon(data=np.linspace(-180, 180, 361, dtype='float32'))
temp = ds.create.data_var.generic('temperature', ('latitude', 'longitude'), dtype='float32')
temp[:] = np.random.rand(181, 361).astype('float32') * 40 - 10
with cfdb.open_dataset('example.cfdb') as ds:
for slices, data in ds['temperature'].iter_chunks(include_data=True):
print(slices, data.shape)
Multivariable Rechunking
Efficiently iterate over multiple variables with synchronized chunks:
with cfdb.open_dataset('data.cfdb') as ds:
# Synchronized iteration over temperature and pressure
for target_chunk, var_data in ds.iter_chunks({'latitude': 50, 'longitude': 50}):
temp = var_data['temperature']
pres = var_data['pressure']
# Perform calculations on aligned blocks
See the full documentation for user guides, concepts, and API reference.
License
This project is licensed under the terms of the Apache Software License 2.0.
1 maintainer
Metadata
1 maintainer
Release files for cfdb 0.10.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| cfdb-0.10.0.tar.gz | 78.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| cfdb-0.10.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 163.3 kB
Release files / cfdb-0.10.0.tar.gz
| Download URL | cfdb-0.10.0.tar.gz |
|---|---|
| Size | 78.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
020a4d1895dd96f8f47dbea35871653fa8d1b35e4ea12658caad7d60719f3c95
|
|
BLAKE2b-256 checksum How to use checksums |
15d10bc8d21cefc73f9c110e032baef98d61e3599d30ff999a9a143f68185401
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.7
|
Release files / cfdb-0.10.0-py3-none-any.whl
| Download URL | cfdb-0.10.0-py3-none-any.whl |
|---|---|
| Size | 85.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f02b23f673f66bab975e26e86db4701a7616fdb21c1fd139fc412c96b6185d04
|
|
BLAKE2b-256 checksum How to use checksums |
d57c37f2bda5326726cda6f37a67b4d6a1536216ea1893d8924423bbd62e6876
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.8.7
|
