cdffs
A file system interface (cdffs) to allow users to work with CDF Files using the fsspec supported/compatible python packages (pandas, xarray etc).
fsspec provides an abstract file system interface to work with local/cloud storages and based on the protocol name (example, s3 or abfs) provided in the path, fsspec translates the incoming requests to storage specific implementations and send the responses back to the upstream package to work with the desired data.
Refer fsspec documentation to get the list of all supported/compatible python packages.
Installation
cdffs is available on PyPI. Install using,
pip install cognite-cdffs
Usage
Important steps to follow when working with CDF Files using the fsspec supported python packages.
- Import
cdffspackage
from cognite import cdffs # noqa
-
Follow instructions from Authentication to authenticate.
-
Read/write the files from/to CDF using
fsspecsupported packages. Example,- Read
zarrfiles using usingxarray.
ds = xarray.open_zarr("cdffs://sample_data/test.zarr")
- Write
zarrfiles usingxarray.
ds.to_zarr("cdffs://sample_data/test.zarr", storage_options={"file_metadata": metadata})
- Read
Refer cdffs.readthedocs.io for more details.
Vendoring
cdffs uses pydandic.v1 package using vendoring. It was mainly introduced to overcome version conflicts
related to the Cognite Notebooks.
Contributing
Want to contribute? Check out CONTRIBUTING.
1 maintainer
Metadata
1 maintainer
Release files for cognite-cdffs 0.3.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| cognite_cdffs-0.3.8.tar.gz | 101.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| cognite_cdffs-0.3.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 214.7 kB
Release files / cognite_cdffs-0.3.8.tar.gz
| Download URL | cognite_cdffs-0.3.8.tar.gz |
|---|---|
| Size | 101.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
57fe8dbdfcbe98a5806cfd8f137c16db739b89358e88c4082d46f36c0faeac2b
|
|
BLAKE2b-256 checksum How to use checksums |
0af0de1b1c2018aec9b7e31b55fcc26190dc97fa8033a96641f08519cdfa5c15
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.9.23
|
Release files / cognite_cdffs-0.3.8-py3-none-any.whl
| Download URL | cognite_cdffs-0.3.8-py3-none-any.whl |
|---|---|
| Size | 112.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e67a542bf2e2745e370df1bcee9ae222dea5728324fcabf527e51c237ca81664
|
|
BLAKE2b-256 checksum How to use checksums |
de3f31590c58d332a4ab6d705311e2a16217f0ed25510be2d11296ec9cd3712f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.9.23
|
