Skip to main content

Keeps a local data repository in syncronisation with ESGF

Project description

Repository health Build Status Codecov

ESGF Scraper is a tool for downloading and processing climate data from the Earth System Grid Federation (ESGF). ESGF is an international collaborative network specifically designed for dissemination of climate model output for large scale projects such as CMIP6.


See the documentation for examples of using esgf-scraper


esgf-scraper is not currently pip installable as the code is not publically accessible. To install, you must checkout the code from GitLab.

git clone
cd esgf-scraper
make virtual-environment
cp esgf_scraper.conf.sample ~/esgf_scraper.conf

After this has been completed, the configuration file will need to be updated with new configuration. See TODO for more information about the contents of the configuration file.


If you’d like to contribute, please make a pull request! The pull request templates should ensure that you provide all the necessary information.


This package is licensed under a MIT license, unless noted otherwise for specific parts.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for esgf-scraper, version 0.4.4
Filename, size File type Python version Upload date Hashes
Filename, size esgf_scraper-0.4.4-py2.py3-none-any.whl (31.8 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size esgf-scraper-0.4.4.tar.gz (42.6 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page