Skip to main content

Keeps a local data repository in syncronisation with ESGF

Project description

Repository health Build Status Codecov

ESGF Scraper is a tool for downloading and processing climate data from the Earth System Grid Federation (ESGF). ESGF is an international collaborative network specifically designed for dissemination of climate model output for large scale projects such as CMIP6.

Documentation

See the documentation for examples of using esgf-scraper

Installation

esgf-scraper is not currently pip installable as the code is not publically accessible. To install, you must checkout the code from GitLab.

git clone git@gitlab.com:magicc/esgf-scraper.git
cd esgf-scraper
make virtual-environment
cp esgf_scraper.conf.sample ~/esgf_scraper.conf

After this has been completed, the configuration file will need to be updated with new configuration. See TODO for more information about the contents of the configuration file.

Contributing

If you’d like to contribute, please make a pull request! The pull request templates should ensure that you provide all the necessary information.

License

This package is licensed under a MIT license, unless noted otherwise for specific parts.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for esgf-scraper, version 0.4.1
Filename, size File type Python version Upload date Hashes
Filename, size esgf_scraper-0.4.1-py2.py3-none-any.whl (31.8 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size esgf-scraper-0.4.1.tar.gz (42.6 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page