virtual-tiff 0.1.0b1

No project description provided

Why Virtualize GeoTIFFs or COGs?

Status

Experimental, proof-of-concept.

Background

This repository started as a simple set of demonstrations to prompt discussions over whether and how we should approach Virtualizing GeoTIFFs and COGs.

First, some thoughts on why we should virtualize GeoTIFFs and/or COGS:

1. Provide faster access to non-cloud-optimized GeoTIFFS that contain some form of internal tiling without any data duplication see notebook #1.
2. Provide fully async I/O for both GeoTIFFs and COGs using Zarr-Python
3. Allow loading a stack of GeoTIFFS/COGS into a data cube while minimizing the number of GET requests relative to using stackstac/xstac, thereby decreasing cost and increasing performance
4. Provide users access to a lazily loaded DataTree providing both the data and the overviews, allowing scientists to use the overviews not only for tile-based visualization but also quickly iterating on analytics
5. Include etags in the virtualized datasets to support reproducibility
6. A motivation that's less clear to me, but maybe possible, is using the virtualization layer to access COGs with disparate CRSs as a single dataset (https://github.com/zarr-developers/geozarr-spec/issues/53)

Getting started

1. Clone the repository: git clone https://github.com/maxrjones/virtual-tiff.git
2. Setup virtual env using uv: uv sync
3. Start a shell in the virtual environment: uv run --all-groups zsh (all-groups includes all the development dependencies in the virtual environment)

Optionally:

• Download all test files using uv run --all-groups python tests/conftest.py
• Run the test suite using uv run --all-groups pytest WARNING: Many will fail due to incomplete status of the implementation

License

virtual-tiff is distributed under the terms of the MIT license.