ionbus_parquet_cache
Python tools for managing versioned Parquet datasets with date partitioning, snapshot versioning, multi-cache lookup, YAML-driven dataset creation, NPD snapshot imports, and CLI workflows for update, cleanup, and synchronization.
Installation
pip install ionbus-parquet-cache
Or install from source:
pip install -e .
Includes
CacheRegistryfor reading from one or more cache locationsDatedParquetDatasetfor date-partitioned, incrementally updated datasetsNonDatedParquetDatasetfor full-refresh reference datasetsDataSourceandDataCleanerextension points- YAML configuration helpers for declarative dataset setup
- Snapshot lineage, cache history, YAML annotations, notes, column descriptions, and optional external provenance sidecars
- CLI modules for dataset creation, NPD imports, updating, cleanup, cache sync, and post-sync hooks
Full documentation on GitHub.
Requirements
- Python >= 3.9
- See
requirements.txtfor runtime dependencies
License
MIT License
1 maintainer
Metadata
1 maintainer
Release files for ionbus-parquet-cache 1.8.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ionbus_parquet_cache-1.8.0.0.tar.gz | 288.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ionbus_parquet_cache-1.8.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 521.5 kB
Release files / ionbus_parquet_cache-1.8.0.0.tar.gz
| Download URL | ionbus_parquet_cache-1.8.0.0.tar.gz |
|---|---|
| Size | 288.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1e933b689118a3e8806c59088b92bd57917a7792bace73d94c2321965a4fad1d
|
|
BLAKE2b-256 checksum How to use checksums |
c44529ed8caec6e1fd405eb7bb6a76bc0e53fc3260e970ec0f4fa350c92fe0c7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.13
|
Release files / ionbus_parquet_cache-1.8.0.0-py3-none-any.whl
| Download URL | ionbus_parquet_cache-1.8.0.0-py3-none-any.whl |
|---|---|
| Size | 232.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
26382e64752157b193ed3afb81372396a3c13812f3a2f07db56da1a5529049e1
|
|
BLAKE2b-256 checksum How to use checksums |
90b1d0f9879f6c34b3c90b5b9363353039253c8c8c6bd9ada2d6f58a60d62752
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.13
|
