Skip to main content

Simple tools to query and retrieve data from the ESGF's CMIP5 and CORDEX projects.

Project description

Python code to manage the analysis of climate model outputs published in the CMIP5 and CORDEX archives

This package provides simple tools to process data from the CMIP5 and CORDEX archives distributed by the Earth System Grid Federation.

This package was developed by F. B. Laliberte and P. J. Kushner as part of the “ExArch: Climate analytics on distributed exascale data archives” G8 Research Initiative grant. http://proj.badc.rl.ac.uk/exarch

This version is a major rewrite from earlier versions.

Frederic B. Laliberte, Paul J. Kushner Univerity of Toronto, 2016

The Natural Sciences and Engineering Research Council of Canada (NSERC/CRSNG) funded FBL and PJK during this project.

If using this code to retrieve and process data from the ESGF please cite: Efficient, robust and timely analysis of Earth System Models: a database-query approach F. Laliberte, Juckes, M., Denvil, S., Kushner, P. J., TBD.

Current ESGF Project Compatibility

  • CMIP5 (full, tested)

  • CORDEX (full, not completely tested)

Version History

1.9.7.x: Code now compatible with CORDEX. Minor bug fixes. Import error fixes. Minor API changes.

1.9.6.x: Minor bug fixes.

1.9.5: Last major version before release 2.0. Future versions before release 2.0 will be minor bugfixes.

Interface can be expected to be stable for the forseeable future.

1.9: Major overhaul. Code ready for new ESGF version. CMIP5 works but other projects might not.

Last version before a LTS version.

1.6: Split the source code in two. Some of the heavy lifiting is now provided

by the netcdf4_soft_links package.

1.5: Added tracking_id and support for different checksum methods.

Compatibility with new ESGF architecture. Rewrite of important code components. Inclusion of modified timeaxis package.

1.4: Stability.

1.3: Added support for FTP archives. Added support for project LRFTIP. Two time series

described by soft links can now be safely concantenated BEFORE a download.

1.2.2: Several bug fixes. Added support for project NMME.

1.2.1: Enabled certficates management within validate, download and download_raw

1.1.0: Required update for the certificates function. The certificates function in prior versions has been deprecated.

1.0.11.2: Fixed a minor bug with validate.

1.0.11: Fixed a certificate issue. Added the possiblity of making a partial validate where only the time stamp in files

is checked. This allows to sidestep a full validate if download_raw is to be used.

1.0.10.1-2: Fixed a bug with h5py. Critical update for 1.0.9.

1.0.9: Added the possibility of downloading the time step BEFORE and / or AFTER the requested times in ‘download’ and ‘download_raw’.

Fixed an authentication problem with newer versions of NETCDF4.

1.0.8: Bug fixes with fancy opendap queries.

1.0.7: Several bug fixes with complex queries. Includes basic updating features.

1.0.6: Major fixes to validate. Fixes to download_raw.

1.0.5: Fixed the certificates manager for the POODLE bug. Fixed the handling of piControl experiments.

1.0.4: Fixed handling of CORDEX nodes, fixed validate for more than one experiment.

1.0.3: Minor changes to help.

1.0.3-rc4: Fixed a minor bug in ‘validate’ command were a model that should have been excluded was not.

1.0.3-rc2: Optimized the ‘ask’ command. Optimized the asynchronous processing for ‘ask’, ‘validate’ and ‘apply’.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cdb_query-1.9.7.2.tar.gz (46.0 kB view details)

Uploaded Source

File details

Details for the file cdb_query-1.9.7.2.tar.gz.

File metadata

  • Download URL: cdb_query-1.9.7.2.tar.gz
  • Upload date:
  • Size: 46.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for cdb_query-1.9.7.2.tar.gz
Algorithm Hash digest
SHA256 08ed1565a40d7d554e9bdaf37e0afd52a1d1f511b80c24f38612ab44941b90cc
MD5 ec9c5d1840a4414539b79815e2bae270
BLAKE2b-256 d344cba13765ec4fdd0832e2f8b4b3fe933830b2eca6b82c0c40a96c5c440f2b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page