MODIS Assimilation and Processing Engine
Project description
MODAPE
=====
|CI| |version| |pyversions| |downloads| |license|
.. |CI| image:: https://travis-ci.org/WFP-VAM/modape.svg?branch=master
:target: https://travis-ci.org/WFP-VAM/modape
.. |version| image:: https://img.shields.io/pypi/v/modape.svg
:target: https://pypi.org/project/modape/
.. |pyversions| image:: https://img.shields.io/pypi/pyversions/modape.svg
:target: https://pypi.org/project/modape/
.. |downloads| image:: https://img.shields.io/pypi/dm/modape.svg
:target: https://pypi.org/project/modape/
.. |license| image:: https://img.shields.io/github/license/WFP-VAM/modape.svg
:target: https://github.com/WFP-VAM/modape/blob/master/LICENSE
|
The **M**\ ODIS **A**\ ssimilation and **P**\ rocessing **E**\ ngine combines a state-of-the art whittaker smoother, implemented as fast C-extension through Cython and including a V-curve optimization of the smoothing parameter, with a HDF5 based processing chain optimized for MODIS data.
The sub-module ``modape.whittaker`` includes the following variations of the whittaker smoother with 2nd order differences:
- **ws2d**: Whittaker with fixed smoothing parameter (``s``)
- **ws2doptv**: Whittaker with V-curve optimization of the smoothing parameter (``s``)
- **ws2doptvp**: Whittaker with V-curve optimization of the smoothing parameter (``s``) and expectile smoothing using asymmetric weights
The MODIS processing chain consists of the following executables, which can be called through commandline:
- ``modis_download``: Query and download raw MODIS products (requires Earthdata credentials)
- ``modis_collect``: Collect raw MODIS data into daily datacubes stored in an HDF5 file
- ``modis_smooth``: Smooth, gapfill and interpolate raw MODIS data using the implemented whittaker smoother
- ``modis_window``: Extract mosaic(s) of multiple MODIS tiles, or subset(s) of a global/tiled MODIS product and export it as GeoTIFF raster in WGS1984 coordinate system
Additional executables:
- ``csv_smooth``: Smooth timeseries stored within a CSV file
- ``rts_smooth``: Smooth a series of raster files stored in a local directory
- ``modis_info``: Retrieve metadata from created HDF5 files
- ``modis_product_table``: MODIS Version 6.0 product table
Installation
------------
**Dependencies:**
modape depends on these packages:
- numpy
- gdal
- h5py
- beautifulsoup4
- requests
- progress
- pandas
Some of these packages (eg. GDAL) can be difficult to build, especially on windows machines. In the latter case it's advisable to download an unofficial binary wheel from `Christoph Gohlke's Unofficial Windows Binaries for Python Extension Packages <https://www.lfd.uci.edu/~gohlke/pythonlibs/>`_ and install it locally with ``pip install`` before installing modape.
**Installation from github:**
.. code:: bash
$ git clone https://github.com/WFP-VAM/modape
$ cd modape
$ pip install .
**Installation from PyPi:**
.. code:: bash
$ pip install modape
Bugs, typos & feature requests
-----
If you find a bug, see a typo, have some kind of troubles running the module or just simply want to have a feature added, please `submit an issue! <https://github.com/WFP-VAM/modape/issues/new>`_
Usage tutorial
-----
All executables can be called with a ``-h`` flag for detailed usage.
For a more detailed tutorial on how to use the executables, please visit `WFP-VAM.github.io/modape <https://wfp-vam.github.io/modape/>`_.
CHANGES
-----
- v0.1.1/2/3:
- changes to MANIFEST.in
- fix issues with pytest and dates in HDF5 for PYTHON 2.7
- fix bug for updating smoothed datasets
- v0.1.0:
- initial release
-----
References:
P. H. C. Eilers, V. Pesendorfer and R. Bonifacio, "Automatic smoothing of remote sensing data," 2017 9th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp), Brugge, 2017, pp. 1-3.
doi: 10.1109/Multi-Temp.2017.8076705
URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8076705&isnumber=8035194
Core Whittaker function adapted from ``whit2`` function from `R` package `ptw <https://cran.r-project.org/package=ptw>`_:
Bloemberg, T. G. et al. (2010) "Improved Parametric Time Warping for Proteomics", Chemometrics and Intelligent Laboratory Systems, 104 (1), 65-74
Wehrens, R. et al. (2015) "Fast parametric warping of peak lists", Bioinformatics, in press.
-----
Author & maintainer:
Valentin Pesendorfer
valentin.pesendorfer@wfp.org
=====
|CI| |version| |pyversions| |downloads| |license|
.. |CI| image:: https://travis-ci.org/WFP-VAM/modape.svg?branch=master
:target: https://travis-ci.org/WFP-VAM/modape
.. |version| image:: https://img.shields.io/pypi/v/modape.svg
:target: https://pypi.org/project/modape/
.. |pyversions| image:: https://img.shields.io/pypi/pyversions/modape.svg
:target: https://pypi.org/project/modape/
.. |downloads| image:: https://img.shields.io/pypi/dm/modape.svg
:target: https://pypi.org/project/modape/
.. |license| image:: https://img.shields.io/github/license/WFP-VAM/modape.svg
:target: https://github.com/WFP-VAM/modape/blob/master/LICENSE
|
The **M**\ ODIS **A**\ ssimilation and **P**\ rocessing **E**\ ngine combines a state-of-the art whittaker smoother, implemented as fast C-extension through Cython and including a V-curve optimization of the smoothing parameter, with a HDF5 based processing chain optimized for MODIS data.
The sub-module ``modape.whittaker`` includes the following variations of the whittaker smoother with 2nd order differences:
- **ws2d**: Whittaker with fixed smoothing parameter (``s``)
- **ws2doptv**: Whittaker with V-curve optimization of the smoothing parameter (``s``)
- **ws2doptvp**: Whittaker with V-curve optimization of the smoothing parameter (``s``) and expectile smoothing using asymmetric weights
The MODIS processing chain consists of the following executables, which can be called through commandline:
- ``modis_download``: Query and download raw MODIS products (requires Earthdata credentials)
- ``modis_collect``: Collect raw MODIS data into daily datacubes stored in an HDF5 file
- ``modis_smooth``: Smooth, gapfill and interpolate raw MODIS data using the implemented whittaker smoother
- ``modis_window``: Extract mosaic(s) of multiple MODIS tiles, or subset(s) of a global/tiled MODIS product and export it as GeoTIFF raster in WGS1984 coordinate system
Additional executables:
- ``csv_smooth``: Smooth timeseries stored within a CSV file
- ``rts_smooth``: Smooth a series of raster files stored in a local directory
- ``modis_info``: Retrieve metadata from created HDF5 files
- ``modis_product_table``: MODIS Version 6.0 product table
Installation
------------
**Dependencies:**
modape depends on these packages:
- numpy
- gdal
- h5py
- beautifulsoup4
- requests
- progress
- pandas
Some of these packages (eg. GDAL) can be difficult to build, especially on windows machines. In the latter case it's advisable to download an unofficial binary wheel from `Christoph Gohlke's Unofficial Windows Binaries for Python Extension Packages <https://www.lfd.uci.edu/~gohlke/pythonlibs/>`_ and install it locally with ``pip install`` before installing modape.
**Installation from github:**
.. code:: bash
$ git clone https://github.com/WFP-VAM/modape
$ cd modape
$ pip install .
**Installation from PyPi:**
.. code:: bash
$ pip install modape
Bugs, typos & feature requests
-----
If you find a bug, see a typo, have some kind of troubles running the module or just simply want to have a feature added, please `submit an issue! <https://github.com/WFP-VAM/modape/issues/new>`_
Usage tutorial
-----
All executables can be called with a ``-h`` flag for detailed usage.
For a more detailed tutorial on how to use the executables, please visit `WFP-VAM.github.io/modape <https://wfp-vam.github.io/modape/>`_.
CHANGES
-----
- v0.1.1/2/3:
- changes to MANIFEST.in
- fix issues with pytest and dates in HDF5 for PYTHON 2.7
- fix bug for updating smoothed datasets
- v0.1.0:
- initial release
-----
References:
P. H. C. Eilers, V. Pesendorfer and R. Bonifacio, "Automatic smoothing of remote sensing data," 2017 9th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp), Brugge, 2017, pp. 1-3.
doi: 10.1109/Multi-Temp.2017.8076705
URL: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8076705&isnumber=8035194
Core Whittaker function adapted from ``whit2`` function from `R` package `ptw <https://cran.r-project.org/package=ptw>`_:
Bloemberg, T. G. et al. (2010) "Improved Parametric Time Warping for Proteomics", Chemometrics and Intelligent Laboratory Systems, 104 (1), 65-74
Wehrens, R. et al. (2015) "Fast parametric warping of peak lists", Bioinformatics, in press.
-----
Author & maintainer:
Valentin Pesendorfer
valentin.pesendorfer@wfp.org
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
modape-0.1.3.tar.gz
(9.3 MB
view hashes)
Built Distributions
Close
Hashes for modape-0.1.3-cp36-cp36m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a654a345acae68cfd89bf790a0e654f91b06f9641581c0905be5cf645ce836e8 |
|
MD5 | f75c3f694c7f5e959946fbaf7d98e175 |
|
BLAKE2b-256 | 27165667ebc417d527fae0cf968b568d16516523ed8ebf80f9d81c412c09d9d0 |
Close
Hashes for modape-0.1.3-cp36-cp36m-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b125acf3730ba9ec73c202df7ecc41125f27bb067fac2bfe83e191c57480173f |
|
MD5 | a9a8fa7043bac0c1c61fdaec62f2061f |
|
BLAKE2b-256 | 696cdd32f8df3c4ff2af976d45065d615d44664c529d8fb6793001bcdcfd69d1 |
Close
Hashes for modape-0.1.3-cp27-cp27m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83565e82546f0d1fc1918a7884f3426a18144af155a2f9843be1aa9a1c0b9d13 |
|
MD5 | 6a6771e2cb6c9ed7be331e8f35497f1a |
|
BLAKE2b-256 | 4b2f5b935a3628ecfba9bc0c38f6e32ee1cf7013636e893f7348996fdf0a76ae |
Close
Hashes for modape-0.1.3-cp27-cp27m-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc3fa670e8bf2ce15e091aa3cd6450263910ce493cbddf8ed7f26f7a830005a2 |
|
MD5 | 90accb237a8ef8acf6acb342cf275cc9 |
|
BLAKE2b-256 | 2d750a7c677cb1479d01c66c605e9e450081d3e7f02434f1fb9afea4f284225d |