Skip to main content

Satellie extraction and cutter

Project description

Introduction

This python code is intended to automate/make easier the data extraction and cutting of satellite data from the netherlands space office (NSO). NSO provides free satellite images from the Netherlands, a downside however is that the NSO provides a very large region and as such a very large data file. This leads to a unnecessary large amount of data, if you only want to study a smaller specific region.

This python code cuts a selected region out of the original satellite image, provided that the selected region is smaller than the original file. And then saves this cutout thus reducing the unnecessary saved data. While also calculating the Normalized difference vegetation index (NVDI, used in crop analysis) of the cutout region. We are working on extracting more variables on satellite images.

This image gives a illustration: Alt text

Getting Started

  1. Get a NSO account, register at https://satellietdataportaal.nl/register.php
  2. First get a GeoJSON file of the region you want to cut. Geojson.io can you help you with that. Note the coordinates have to be in WGS84! ( Which should be standard for a geojson.)
  3. Make a instance of nso_geojsonregion with instance of the geojson region you have, where you want to store the cropped files and the NSO account based on step 0.
  4. Retrieve download links for the specific region you want to have.
  5. Download the found links.

Example code.

# This the way the import nso.
import satellite_images_nso.api.nso_georegion as nso
path_geojson = "/src/example/example.geojson"
# The first parameter is the path to the geojson, the second the map where the cropped satellite data will be installed
georegion = nso.nso_georegion(path_geojson,"/src/output/",\
                              YOUR_USER_NAME_HERE,\
                             YOUR_PASSWORD_HERE)

# This method fetches all the download links to all the satelliet images which contain region in the geojson.
links = georegion.retrieve_download_links()

# Downloads a satelliet image from the NSO, make a crop out of it so it fits the geojson region and calculate the NVDI index.
# The output will stored in the designated output folder.
georegion.execute_link(links[0])
# The parameters are : execute_link(self, link, delete_zip_file = False, delete_source_files = True, check_if_file_exists = True)
# With the parameters you can decide if you want to keep the original satellite files.

# The sat_manipulator gives other handy transmations on satellite data.
import satellite_images_nso.api.sat_manipulator as sat_manipulator

# This function reads a .tif file, which is a format the satellite data is stored in,  and converts it to a pixel based geopandas dataframe.
# For machine learning purposes.
path_to_vector = "path/to/folder/*.tif"
geo_df_pixel = sat_manipulator.tranform_vector_to_pixel_gpdf(path_to_vector)

Installation.

Install this package with: pip install satellite_images_nso

Be sure you've installed GDAL already on your computer. Other python dependencies will install automatically (Fiona>=1.8.13, GDAL>=3.0.4, geopandas>=0.7.0, rasterio>=1.1.3 Shapely>=1.7.0). If you don't have gdal installed on your computer or if it doesn't work follow the instruction below.

Install GDAL on Windows

If you are a Windows user you have to install the GDAL dependency yourself via a wheels.

Instead install these wheels with pip install XXX.XX.XX.whl.

Go to https://www.lfd.uci.edu/~gohlke/pythonlibs/ for the wheels of these depencies:

Depencencies are : "Fiona>=1.8.13", "GDAL>=3.0.4", "geopandas>=0.7.0","rasterio>=1.1.3","Shapely>=1.7.0"

Install GDAL on MacOS

Install GDAL by using Brew:
brew install GDAL

Run as a docker container

docker run -it --entrypoint bash dockerhubpzh/satellite_images_nso_docker

See: https://hub.docker.com/r/dockerhubpzh/satellite_images_nso_docker

Local development

Run rebuild.bat to build and install package on local computer.

Author

Michael de Winter

Daniel Overdevest

Yilong Wen

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

satellite_images_nso-1.1.10.tar.gz (13.0 kB view details)

Uploaded Source

Built Distribution

satellite_images_nso-1.1.10-py3-none-any.whl (14.7 kB view details)

Uploaded Python 3

File details

Details for the file satellite_images_nso-1.1.10.tar.gz.

File metadata

  • Download URL: satellite_images_nso-1.1.10.tar.gz
  • Upload date:
  • Size: 13.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

File hashes

Hashes for satellite_images_nso-1.1.10.tar.gz
Algorithm Hash digest
SHA256 d38c8cda39fd3061d8ed4f9b1c76ed1f6f695820e8ef5bbaad02a721ba2a02fe
MD5 fef3ebcfddf979aa2dde13d8ab84abeb
BLAKE2b-256 b9766a1c2064abf17c0008c8a16c3b001e35cc919214b6c1919f0e848cc03133

See more details on using hashes here.

File details

Details for the file satellite_images_nso-1.1.10-py3-none-any.whl.

File metadata

  • Download URL: satellite_images_nso-1.1.10-py3-none-any.whl
  • Upload date:
  • Size: 14.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

File hashes

Hashes for satellite_images_nso-1.1.10-py3-none-any.whl
Algorithm Hash digest
SHA256 6463319aea38b44fe310232d2fb8bb1b590cc1231c5363b30d4b9d0248d7fc98
MD5 6fc917a553eb25083d48cde3653876a6
BLAKE2b-256 6bbd173c5f3879178d007618f6ad790a2d0a2e330b253508585e8fb015e8f4c3

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page