Python library for processing VIIRS data
Project description
viirs-tools
viirs-tools is a Python library that provides basic algorithms for retrieving meteorological data from VIIRS (Visible Infrared Imaging Radiometer Suite) satellite shots. This project started as a diploma (or thesis) project, and the primary goals of the viirs-tools library are threefold:
-
Faster Data Processing: The library aims to make the process of working with VIIRS data much quicker than the standard approachs. The goal is to provide near-real-time in-memory data processing capabilities, allowing researchers and scientists to access and analyze the data in a more timely manner. However, it's important to note that this speed improvement may come at the cost of reduced accuracy, as the library's algorithms may not be as thoroughly tested and validated as the NASA's (or other) standard processing pipeline.
-
Easier VIIRS Data Utilization: In addition to the speed improvements, the library is designed to make it easier for researchers and scientists to work with VIIRS data.
-
Flexible Data Handling: One of the key aims of the
viirs-toolslibrary is to provide users with handy access to the underlying algorithms, allowing them to work with the data in a variety of formats, includingxr.DataArray, andnp.ndarray. This flexibility ensures that the library can be seamlessly integrated into a wide range of data processing workflows.
Installation
To install viirs-tools, you can use pip:
pip install viirs-tools
If you want to use the assimilator extra module, which allows you to download data from NASA servers:
pip install viirs-tools[assimilator]
Note that this module functions rely on the cmrfetch package, you need to install and configure it first.
Usage
The viirs-tools library provides the following core modules and their main functions:
-
Runner class: recommended entry point for getting desired algs
-
algs module:
- cloud submodule:
vibcm_day: Day reflectance/thermal I-bands cloud test. [^1]vifcm_day,vifcm_night: Day and night I-bands cloud tests used in the [^2].
- index submodule:
ndvi: normalized difference vegetation indexndsi: normalized snow vegetation index
- night submodule:
naive: Day/night mask, based on the difference between presence of reflectance and thermal data, for both I- and M-bands
- water submodule:
water_bodies_day: Day reflectance tests for water bodies from [^2]
- lst submodule:
mono_window_i05,mono_window_m16,mono_window_m15: LST retrieval for I05 band, based on the LANDSAT-8 alg [^3]
- utils submodule:
merge_day_night: Merging of 2 datasets by day/night mask
- cloud submodule:
-
Assimilator module:
- Assimilator:
assimilate: Retrieving data from NASA archives using cmrfetch, with support for handy data collection process management
- Reading
read_npp_viaes_l1: Reading VIIRS/NPP Imagery Resolution 6-Min L1 Swath SDR 375m product filesread_npp_vmaes_l1: Reading VIIRS/NPP Moderate Resolution 6-Min L1 Swath SDR and GEO 750m product filesread_npp_cldmsk_l2: Reading VIIRS/SNPP Cloud Mask 6-Min Swath 750m product files
- ReadingHelpers
- Contains some helper functions for reading files that aren't supported by
SatPymodule (some examples of using them in the previous module)
- Contains some helper functions for reading files that aren't supported by
- Assimilator:
from viirs_tools import Runner, AlgsIndex
...
runner = Runner()
runner.show_algs_all() # show all available algs from each alg type
ndvi_func = runner.get_alg_index(AlgsIndex.NDVI)
ndvi = ndvi_func(ri2, ri1)
cloud_func = runner.get_alg_cloud()
cloud_mask = cloud_func(ri1, ri2, ri3, bi4, bi5)
...
Additional tools
In the scripts folder some useful tools for local satellite data analysis could be found, such as assimilate.py script.
References
[^1]: M.Piper, T.Bahr (2015). A RAPID CLOUD MASK ALGORITHM FOR SUOMI NPP VIIRS IMAGERY EDRS.
[^2]: W.Schroeder, P.Oliva, L.Giglio, I.A.Csiszar (2014). The New VIIRS 375 m active fire detection data product: Algorithm description and initial assessment.
[^3]: U.Avdan, G.Jovanovska (2016). Algorithm for Automated Mapping of Land Surface Temperature Using LANDSAT 8 Satellite Data
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file viirs_tools-2.0.2.tar.gz.
File metadata
- Download URL: viirs_tools-2.0.2.tar.gz
- Upload date:
- Size: 18.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6d0fd6c6d6b9e88cc0f0118f06f4b1a48f0f81a06cefb685b53fe9d0e9356cfd
|
|
| MD5 |
3bb2aa4884e3cfa31a38d777e1efd465
|
|
| BLAKE2b-256 |
e7d52840e87364d0c66d0bef86b6ba09e72365195fdfda3db347a6503b3f54cd
|
Provenance
The following attestation bundles were made for viirs_tools-2.0.2.tar.gz:
Publisher:
publish.yml on Veon2479/viirs-tools
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
viirs_tools-2.0.2.tar.gz -
Subject digest:
6d0fd6c6d6b9e88cc0f0118f06f4b1a48f0f81a06cefb685b53fe9d0e9356cfd - Sigstore transparency entry: 767784805
- Sigstore integration time:
-
Permalink:
Veon2479/viirs-tools@b8cc0540e70ca9227db638cd9c23dd518656b46b -
Branch / Tag:
refs/tags/v2.0.2 - Owner: https://github.com/Veon2479
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@b8cc0540e70ca9227db638cd9c23dd518656b46b -
Trigger Event:
release
-
Statement type:
File details
Details for the file viirs_tools-2.0.2-py3-none-any.whl.
File metadata
- Download URL: viirs_tools-2.0.2-py3-none-any.whl
- Upload date:
- Size: 18.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1d9e480118afa05470d62a1545dd8c282b2a3bf3a81339550d1b0fc914a15301
|
|
| MD5 |
8ec7b16d494fd48bd7762b0e3d470ed9
|
|
| BLAKE2b-256 |
d8939fa7e136bcebe0cac90a0c791ccc9d7781fd8145ae206d0b92b552a4f583
|
Provenance
The following attestation bundles were made for viirs_tools-2.0.2-py3-none-any.whl:
Publisher:
publish.yml on Veon2479/viirs-tools
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
viirs_tools-2.0.2-py3-none-any.whl -
Subject digest:
1d9e480118afa05470d62a1545dd8c282b2a3bf3a81339550d1b0fc914a15301 - Sigstore transparency entry: 767784808
- Sigstore integration time:
-
Permalink:
Veon2479/viirs-tools@b8cc0540e70ca9227db638cd9c23dd518656b46b -
Branch / Tag:
refs/tags/v2.0.2 - Owner: https://github.com/Veon2479
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@b8cc0540e70ca9227db638cd9c23dd518656b46b -
Trigger Event:
release
-
Statement type: