Skip to main content

Python module which adds new CMEMS downloads services (applied mainly to big data requests)

Project description

ads4MO - Added Download Services

Build Status Build status PyPi Gitter

I developed this software because motivated to improve my efficiency and productivity. It is just an attemp/idea/prototype and it is not fully optimased or considered stable.

This project gave me also ideas to develop other tools as tool4NC, JupLab4NetCDF and MerOC. To know more about them just visit the projects web pages which are hyperlinked above.

I created also a chat-community powered by "Gitter" where is possible have an exchange of ideas,functionalities,bugs and many more. Just click Gitter to acces the chat room.

Many thanks to visit this page and try this python software.

Carmelo Sammarco

Introduction:

It is possible download data by MONTH, DEPTH or DAY until a maximum of three selected variables(Planning to increase this number thought). It brings in a very intuitive scripting way what was already proposed with MerOC.

Be aware that:

The tool is in development so it can be possible find bugs, errors and imprecisions. Please to report them if you find one.

Dependencies:

The dependencies required which are not installed by default are listed below:

  • motuclient>=1.8.1
  • ftputil>=3.4

Installation and module usage

It is possible to install and then use in both UNIX and Windows operative systems following the below steps:

pip install ads4MO

we can import the module as:

from ads4MO import download

Once the module is imported we can call the interactive download process typing;

download()

At this point the system is going to ask:

  • Username and password

  • Type of the download which can be set typing one of the following:

    • MONTH: The entire period selected will be downloaded by months
    • DEPTH: The entire period selected will be downloaded by depth levels
    • DAY: The entire period selected will download as daily files
    • MONTH&DEPTH: The entire period selected will be downloaded by months and depth levels
    • YEAR: The entire period selected will be downloaded by years. Very usefull just when you want extract a grid point (The --longitude-min = --longitude-min and --latitude-min = --latitude-max).
  • Starting/Ending Time: If not values as HH:MM:SS are typed then "12:00:00" is going to be used as default value.

  • Motu client script which is generated by the CMEMS web portal. Please to copy and paste just from the "--motu" until the end. You can leave untouched "--out-dir <OUTPUT_DIR> --out-name <OUTPUT_FILENAME> --user <USERNAME.> --pwd <PASSWORD.>" because they were already set previously.

Following an example of the full script generted by the Web-portal:

python -m motuclient  --motu http://..... --service-id GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS --product-id global-analysis-forecast-phy-001-024 --longitude-min -180 --longitude-max 179.9166717529297 --latitude-min -80 --latitude-max 90 --date-min "2019-04-19 12:00:00" --date-max "2019-04-19 12:00:00" --depth-min 0.493 --depth-max 0.4942 --variable thetao --variable bottomT  --out-dir <OUTPUT_DIR> --out-name <OUTPUT_FILENAME> --user <USERNAME> --pwd <PASSWORD>

What you need to use as module's input:

--motu http://nrt.cmems-du.eu/motu-web/Motu --service-id GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS --product-id global-analysis-forecast-phy-001-024 --longitude-min -180 --longitude-max 179.9166717529297 --latitude-min -80 --latitude-max 90 --date-min "2019-04-19 12:00:00" --date-max "2019-04-19 12:00:00" --depth-min 0.493 --depth-max 0.4942 --variable thetao --variable bottomT  --out-dir <OUTPUT_DIR> --out-name <OUTPUT_FILENAME> --user <USERNAME> --pwd <PASSWORD>

The results are going to be downloaded in the file path in which the terminal/command-prompt was at the moment of the data request.

Stand-alone applications (No Python installation required):


The stand-alone App for Windows OS can be downloaded from HERE.

The APP was developed, compiled and tested in Windows 10 environment. As soon as I have time I will try to test it in other Windows environments. It will generate a folder in which all the data downloaded are going to be stored. This folder will be stored in the same system path where the executable "ads4mo-win.exe" is located.


The stand-alone App for macOS can be downloaded from HERE.

If the APP doesn't start because of "unidentified developer" message then you need to give the system the permission to run it. In more details, please to go in Security & Privacy (Tab "General") and then click on the button which will allows the execution of the tool. It will create a Desktop folder which will store all the data downloaded.


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ads4MO-0.0.5.tar.gz (11.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ads4MO-0.0.5-py3-none-any.whl (21.5 kB view details)

Uploaded Python 3

File details

Details for the file ads4MO-0.0.5.tar.gz.

File metadata

  • Download URL: ads4MO-0.0.5.tar.gz
  • Upload date:
  • Size: 11.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.3

File hashes

Hashes for ads4MO-0.0.5.tar.gz
Algorithm Hash digest
SHA256 483ccfd3b1e6d3095d75e803759b136a3f794b4ff6730d333e7064196e30d559
MD5 633a66cf7ffbfb70b63b166db252b283
BLAKE2b-256 44331f13434915c157ba2e926f36614fb88d82ba85a5d89336b383c316f5534c

See more details on using hashes here.

File details

Details for the file ads4MO-0.0.5-py3-none-any.whl.

File metadata

  • Download URL: ads4MO-0.0.5-py3-none-any.whl
  • Upload date:
  • Size: 21.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3.post20200330 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.7.3

File hashes

Hashes for ads4MO-0.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 be635cb59413253070b80e6da4685e6515256453ac4409602b370f0dde9fbedb
MD5 e127e00bf3c85131b8cc29299c0bd7c7
BLAKE2b-256 a43757f5e0431815040cdb9acff2b519500102629b547b95cb9453de2c18de63

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page