Python client library for accessing dClimate weather and climate data
Project description
dClimate-Client-Py
Retrieve dClimate GIS zarr datasets stored on IPFS
Uses STAC (SpatioTemporal Asset Catalog) for dataset discovery and py-hamt to access Zarr data structures stored efficiently on IPFS.
Filtering and aggregation are packaged into convenience functions optimized for flexibility and performance.
Looking for JavaScript? Check out our JavaScript client for Node.js and browser environments.
Usage
from datetime import datetime
import dclimate_client_py as client
from dclimate_client_py import dClimateClient
# --- Recommended: Using dClimateClient (async context manager) ---
async def main():
# The client manages IPFS connections automatically
# No need to import or configure KuboCAS directly!
async with dClimateClient() as dclimate:
# Load datasets by name from the internal catalog
# For datasets with multiple variants, you must specify which variant
# Returns a tuple: (dataset, metadata)
dataset, metadata = await dclimate.load_dataset(
dataset="temperature_2m",
collection="era5", # Can also pass "ecmwf_era5"
organization="ecmwf",
variant="finalized", # Required for multi-variant datasets
return_xarray=False # Returns GeotemporalData wrapper (default)
)
# Check metadata about what was loaded
print(f"Loaded: {metadata['slug']}")
print(f"CID: {metadata['cid']}")
print(f"Timestamp: {metadata.get('timestamp')}") # If available from URL fetch
print(f"Source: {metadata['source']}") # 'stac' or 'direct_cid'
# Apply queries using the GeotemporalData interface
dataset_filtered = dataset.point(latitude=40.875, longitude=-104.875)
dataset_filtered = dataset_filtered.time_range(
datetime(2023, 1, 1),
datetime(2023, 1, 5)
)
data_dict = dataset_filtered.as_dict()
print(data_dict['data'])
# Custom IPFS endpoints (optional)
async def main_custom_ipfs():
async with dClimateClient(
gateway_base_url="https://ipfs.io",
rpc_base_url="http://localhost:5001"
) as dclimate:
dataset, metadata = await dclimate.load_dataset(
dataset="temperature_2m",
collection="era5",
organization="ecmwf",
variant="finalized"
)
# Query dataset...
# Get raw xarray.Dataset directly
async def main_xarray():
async with dClimateClient() as dclimate:
xr_dataset, metadata = await dclimate.load_dataset(
dataset="temperature_2m",
collection="era5",
organization="ecmwf",
variant="finalized",
return_xarray=True # Returns xarray.Dataset
)
print(xr_dataset)
print(f"Dataset CID: {metadata['cid']}")
# List available datasets from the STAC catalog
from dclimate_client_py import list_available_datasets, load_stac_catalog
# Load the STAC catalog
stac_catalog = load_stac_catalog("https://ipfs-gateway.dclimate.net")
# List all available datasets
datasets = list_available_datasets(stac_catalog)
for collection_id, info in datasets.items():
print(
f"Collection: {info['title']} ({collection_id})"
+ (f" | org: {info['organization']}" if info.get('organization') else "")
)
print(f" Dataset types: {', '.join(info['types'])}")
More examples can be found at dClimate Jupyter Notebooks. To run your own IPFS gateway follow the instructions for installing ipfs. For additional assistance find us on Discord, if you are an organization or business reach out to us at community at dclimate dot net.
Create and activate a virtual environment:
uv venv .venv
source .venv/bin/activate # macOS/Linux
.\.venv\Scripts\activate # Windows
Install Dependencies
uv sync --extra dev --extra testing
Run tests for your local environment
uv run pytest tests/
Use Coverage
uv run pytest --cov=dclimate_client_py tests/ --cov-report=xml
Environment requirements
- Optionally you can run your own IPFS Server to host your own datasets or connect to others.
File breakdown:
client.py
Entrypoint to code, contains geo_temporal_query, which combines all possible subsetting
and aggregation logic in a single function. Can output the data as either a dict
or bytes representing an xarray dataset.
dclimate_zarr_errors.py
Various exceptions to be raised for bad or invalid user input.
geo_utils.py
Functions to manipulate xarray datasets. Contains polygon, rectangle, circle and point spatial
subsetting options, as well as temporal subsetting. Also allows for both spatial and temporal
aggregations.
stac_catalog.py
STAC (SpatioTemporal Asset Catalog) integration for dClimate datasets. Provides functions to:
- Fetch the latest STAC catalog CID from the dClimate IPFS gateway
- Load and navigate STAC catalogs stored on IPFS
- Resolve dataset names to IPFS CIDs using the STAC catalog structure
- List all available datasets and collections
Uses a custom IPFSStacIO implementation to transparently resolve ipfs:// URIs via HTTP gateways, allowing pystac to work seamlessly with IPFS-hosted catalogs.
ipfs_retrieval.py
Functions for loading Zarr datasets from IPFS using py-hamt. Handles interaction with IPFS gateways and RPC endpoints through the KuboCAS interface.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dclimate_client_py-0.5.3.tar.gz.
File metadata
- Download URL: dclimate_client_py-0.5.3.tar.gz
- Upload date:
- Size: 13.4 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
89d98efda5bb3773e3b9353af153cb56ab67534aa93fc99a506f097e2c3129ac
|
|
| MD5 |
d59a2df001127c1630b3bd4fe4617d7d
|
|
| BLAKE2b-256 |
190082acaf101fda08102e6e1c366f130177377011b095bb0e4de40c24670888
|
File details
Details for the file dclimate_client_py-0.5.3-py3-none-any.whl.
File metadata
- Download URL: dclimate_client_py-0.5.3-py3-none-any.whl
- Upload date:
- Size: 35.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.6.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c834dd94ec6d77d9199875bd47f55261c114a1a632686a136dcab62cb94d9aac
|
|
| MD5 |
116ea57ddcb348ea21504f76e42e657f
|
|
| BLAKE2b-256 |
386f4a14075cae01f8750fd74e0ac3b3dfed44defdc97daed31c77d31e891aa7
|