Skip to main content

Keeps a local data repository in syncronisation with ESGF

Project description

Repository health

Build Status

Codecov

ESGF Scraper is a tool for downloading and processing climate data from the Earth System Grid Federation (ESGF). ESGF is an international collaborative network specifically designed for dissemination of climate model output for large scale projects such as CMIP6.

Documentation

See the documentation for examples of using esgf-scraper

Installation

esgf-scraper is not currently pip installable as the code is not publically accessible. To install, you must checkout the code from GitLab.

git clone git@gitlab.com:magicc/esgf-scraper.git
cd esgf-scraper
make virtual-environment
cp esgf_scraper.conf.sample ~/esgf_scraper.conf

After this has been completed, the configuration file will need to be updated with new configuration. See TODO for more information about the contents of the configuration file.

Contributing

If you’d like to contribute, please make a pull request! The pull request templates should ensure that you provide all the necessary information.

License

This package is licensed under a MIT license, unless noted otherwise for specific parts.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

esgf-scraper-0.4.4.tar.gz (42.6 kB view hashes)

Uploaded Source

Built Distribution

esgf_scraper-0.4.4-py2.py3-none-any.whl (31.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page