Skip to main content

Keeps a local data repository in syncronisation with ESGF

Project description

Repository health

Build Status


ESGF Scraper is a tool for downloading and processing climate data from the Earth System Grid Federation (ESGF). ESGF is an international collaborative network specifically designed for dissemination of climate model output for large scale projects such as CMIP6.


See the documentation for examples of using esgf-scraper


esgf-scraper is not currently pip installable as the code is not publically accessible. To install, you must checkout the code from GitLab.

git clone
cd esgf-scraper
make virtual-environment
cp esgf_scraper.conf.sample ~/esgf_scraper.conf

After this has been completed, the configuration file will need to be updated with new configuration. See TODO for more information about the contents of the configuration file.


If you’d like to contribute, please make a pull request! The pull request templates should ensure that you provide all the necessary information.


This package is licensed under a MIT license, unless noted otherwise for specific parts.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

esgf-scraper-0.4.4.tar.gz (42.6 kB view hashes)

Uploaded Source

Built Distribution

esgf_scraper-0.4.4-py2.py3-none-any.whl (31.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page