intake-esgf
Badges
Announcement
ESGF is in the process of decomissioning the old index technology (Solr). While this process takes place, you may find some services may be broken or disappear completely. The information in the US-based Solr indices has been moved into a Globus (ElasticSearch) index which is this package's default index. As the federation prepares for CMIP7, we will enable a new/additional index architecure based on the Spatio Temporal Asset Catalog (STAC) specification.
Overview
intake-esgf gives you programmatic access to ESGF holdings. We aim to hide some of the complexity of obtaining ESGF data and get it to the user as fast as we can.
- Indices are queried in parallel and report when they fail to return a response. The results are aggregated and presented to the user as a pandas DataFrame.
- The locations of the data are hidden from the user. Internally we track which locations provide the user the fastest transfers and automatically favor them for you.
- Files are downloaded in parallel into a local cache which mirrors the remote storage directory structure. They are returned to the user as a dictionary of xarray Datasets. Your search script then becomes the way you download data as well as how you load it into memory for your analysis.
- Prior to downloading data, we first check that it is not already available locally. This could be because you had previously downloaded it, but also because you are working on a server that has direct access.
- Cell measure information is harvested from your search results and automatically included in the returned datasets.
- The old (Solr) and new (STAC) index types are supported simultaneously.
For a full listing of features with code examples, please consult the documentation.
Installation
You may install intake-esgf using pip:
python -m pip install intake-esgf
or conda-forge:
conda install -c conda-forge intake-esgf
Once installed, you can verify installation with a 5 minute automated tutorial with:
python -m intake_esgf
Metadata
Release files for intake-esgf 2026.9.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| intake_esgf-2026.9.4.tar.gz | 281.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| intake_esgf-2026.9.4-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 351.8 kB
Release files / intake_esgf-2026.9.4.tar.gz
| Download URL | intake_esgf-2026.9.4.tar.gz |
|---|---|
| Size | 281.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
76829e3cc84d71a9c79907c1d770f608d6faabe0af7aa309c8d1d892fba0f725
|
|
BLAKE2b-256 checksum How to use checksums |
299f27f0d0b1faaa075426161306b6bd1123d0b923e1397c3c3fab5af4560aff
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.9 {"installer":{"name":"uv","version":"0.12.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / intake_esgf-2026.9.4-py3-none-any.whl
| Download URL | intake_esgf-2026.9.4-py3-none-any.whl |
|---|---|
| Size | 70.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
5fdb6de9117823c5f5be71b282d9c3b0ffb42bd7a917b3e111eba9b1f214d6db
|
|
BLAKE2b-256 checksum How to use checksums |
daa07438cf3ad3259d0bdb8144566fc96ff5e609b329d8f3e07fdc9450837c23
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.9 {"installer":{"name":"uv","version":"0.12.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|