Large Data Comparison for Python
ldcpy is a utility for gathering and plotting metrics from NetCDF or Zarr files using the Pangeo stack. It also contains a number of statistical and visual tools for gathering metrics and comparing Earth System Model data files.
- AUTHORS:
Alex Pinard, Allison Baker, Anderson Banihirwe, Dorit Hammerling
- COPYRIGHT:
2025 University Corporation for Atmospheric Research
- LICENSE:
Apache 2.0
Documentation and usage examples are available here.
Reference to ldcpy paper
Pinard, D. M. Hammerling, and A. H. Baker. Assessing differences in large spatiotemporal climate datasets with a new Python package. In The 2020 IEEE International Workshop on Big Data Reduction, 2020. doi: 10.1109/BigData50022.2020.9378100.
Link to paper: https://doi.org/10.1109/BigData50022.2020.9378100
Installation using Conda (recommended)
Ensure conda is up to date and create a clean Python (3.10+) environment:
conda update conda
conda create --name ldcpy python=3.10
conda activate ldcpyNow install ldcpy:
conda install -c conda-forge ldcpyAlternative Installation
Ensure pip is up to date, and your version of python is at least 3.10:
pip install --upgrade pip
python --versionInstall cartopy using the instructions provided at https://scitools.org.uk/cartopy/docs/latest/installing.html.
Then install ldcpy:
pip install ldcpyAccessing the tutorial
If you want access to the tutorial notebook, clone the repository (this will create a local repository in the current directory):
git clone https://github.com/NCAR/ldcpy.gitStart by enabling Hinterland for code completion and code hinting in Jupyter Notebook and then opening the tutorial notebook:
jupyter nbextension enable hinterland/hinterland
jupyter notebookThe tutorial notebook can be found in docs/source/notebooks/TutorialNotebook.ipynb, feel free to gather your own metrics or create your own plots in this notebook!
Other example notebooks that use the sample data in this repository include PopData.ipynb and MetricsNotebook.ipynb.
The AWSDataNotebook grabs data from AWS, so can be run on a laptop with the caveat that the files are large.
The following notebooks asume that you are using NCAR’s JupyterHub (https://jupyterhub.hpc.ucar.edu): LargeDataGladenotebook.ipynb, CAMNotebook,ipynb, and error_bias.ipynb
Re-create notebooks with Pangeo Binder
Try the notebooks hosted in this repo on Pangeo Binder. Note that the session is ephemeral. Your home directory will not persist, so remember to download your notebooks if you make changes that you need to use at a later time!
Note: All example notebooks are in docs/source/notebooks (the easiest ones to use in binder first are TutorialNotebook.ipynb and PopData.ipynb)
1 maintainer
Metadata
1 maintainer
Release files for ldcpy 0.20
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| ldcpy-0.20.tar.gz | 282.4 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ldcpy-0.20-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 282.5 MB
Release files / ldcpy-0.20.tar.gz
| Download URL | ldcpy-0.20.tar.gz |
|---|---|
| Size | 282.4 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c0d48ac8a360d2d852900da32c403d3fa9b86274126e8123f66caaab9f809f72
|
|
BLAKE2b-256 checksum How to use checksums |
7a95e632ad257107f87d125f040d6cd701136448c1fecbea26fa88c4b866492c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.2
|
Release files / ldcpy-0.20-py3-none-any.whl
| Download URL | ldcpy-0.20-py3-none-any.whl |
|---|---|
| Size | 49.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
54cdd6514f3af172221054b9758c2a62d021d7c814c052405331aff3b051f1b3
|
|
BLAKE2b-256 checksum How to use checksums |
c3cfd55164882e2e604eaa12d56db0087e59b850f06352fd7e088b60407a4152
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.2
|
