Keeps a local data repository in syncronisation with ESGF
Project description
Repository health |
ESGF Scraper is a tool for downloading and processing climate data from the Earth System Grid Federation (ESGF). ESGF is an international collaborative network specifically designed for dissemination of climate model output for large scale projects such as CMIP6.
Documentation
See the documentation for examples of using esgf-scraper
Installation
esgf-scraper is not currently pip installable as the code is not publically accessible. To install, you must checkout the code from GitLab.
git clone git@gitlab.com:magicc/esgf-scraper.git cd esgf-scraper make virtual-environment cp esgf_scraper.conf.sample ~/esgf_scraper.conf
After this has been completed, the configuration file will need to be updated with new configuration. See TODO for more information about the contents of the configuration file.
Contributing
If you’d like to contribute, please make a pull request! The pull request templates should ensure that you provide all the necessary information.
License
This package is licensed under a MIT license, unless noted otherwise for specific parts.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file esgf-scraper-0.4.4.tar.gz.
File metadata
- Download URL: esgf-scraper-0.4.4.tar.gz
- Upload date:
- Size: 42.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | bed0e6bb1aac5dd31fabd308072c1aba2efcb81d3029c0e1c18fb934565d6395 |
|
| MD5 | aa8d6c9461cad5f344e102e0692dd480 |
|
| BLAKE2b-256 | 1d0b66e10aea76e1c202076451733915ba141b28fd31ab0820e31d1b69902262 |
File details
Details for the file esgf_scraper-0.4.4-py2.py3-none-any.whl.
File metadata
- Download URL: esgf_scraper-0.4.4-py2.py3-none-any.whl
- Upload date:
- Size: 31.8 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/41.2.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | c68e4db443716c71c0f210e43247351c12bebe3cad6a35225bd29e706d81b290 |
|
| MD5 | 5ec7ce312ef7859dafc662e736945b65 |
|
| BLAKE2b-256 | cb959c0b12a8862a9d6d2f7f0fbead2ca2cf2415731209113d2d50e047da674d |
