Skip to main content

help download modis files with token and multi threading processing

Project description

1 ModisDownload

help ours down load from base url https://ladsweb.modaps.eosdis.nasa.gov/ when i use this packages , our bandwidth work in deadline with the first version we can use this download all modis file with any time in any area use like this

2 Example code

2.1 Query Productions

We can query productions which can be downloaded by our API or get from {your ModisDownload package install directory}/temp/sensor.csv

# search products which can be downloaded
from ModisDownload.Visited import search_p

if __name__ == '__main__':
    search_p()

2.2 Query Area Names

We can query productions which can be downloaded by our API or get from {your ModisDownload package install directory}/temp/country.json

# search products which can be downloaded
from ModisDownload.Visited import search_area

if __name__ == '__main__':
    search_area()

2.3 Download products

# download data main class
from ModisDownload.Visited import GetHtml

if __name__ == '__main__':
    # get your token in https://ladsweb.modaps.eosdis.nasa.gov/#generate-token
    token = "your token can be found in https://ladsweb.modaps.eosdis.nasa.gov/#generate-token"

    # init download main class
    obj = GetHtml()

    # set your product name
    product_name = "Mod04_3k"

    # set your query dates
    # query one day use 2020-01-01
    # query dates use start_time..end_time like 2021-01-01..2022-01-01
    # query multi dates like 2020-01-01,2021-01-01..2022-01-01,... and so on
    query_dates = "2020-01-01,2021-01-01..2021-02-01"

    # query area can use name of country or longitude and latitude
    # county like china or other names,you can see all names by search_area() in ModisDownload.Visited
    # area by longitude and latitude like
    # (longitude,latitude)
    # (a,b) ----------
    #       -        -
    #       -        -
    #       -        -
    #       ---------- (c,d)
    # area like xayb,xcyd
    area = "x120y40,x140y20"

    # download files save directory
    save_dir = "./download"

    # thread number default 5
    thread_num = 5

    # max try number if your net close download will be shutdown,
    # so we will retry some time to make sure download success,default max try number is 10
    max_try = 10

    # if you use proxy you should set you proxy port if port is None not use proxy default port is None
    port = None

    # chunk size is stream I/O size don't change
    chunk_size = 1 << 20

    # download main function
    obj.download_main(sensor_name=product_name, dates=query_dates, area=area, download_dir=save_dir,
                      thread_num=thread_num,
                      max_try=max_try, port=port, chunk_size=chunk_size)

    # only need download urls
    obj.download_main_url(sensor_name=product_name, dates=query_dates, area=area, download_dir=save_dir,
                          save_dir="your downloads urls save path")

2.4 Update ModisDownload

update productions names and area

# reinit package
from ModisDownload.Visited import reload

if __name__ == '__main__':
    reload()

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ModisDownload-2.0.tar.gz (11.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ModisDownload-2.0-py3-none-any.whl (13.9 kB view details)

Uploaded Python 3

File details

Details for the file ModisDownload-2.0.tar.gz.

File metadata

  • Download URL: ModisDownload-2.0.tar.gz
  • Upload date:
  • Size: 11.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.7.8rc1

File hashes

Hashes for ModisDownload-2.0.tar.gz
Algorithm Hash digest
SHA256 fc605d6fe3c0f0e8a9b64d046263f894c5cbef7e6722bc311d6d68c97603a1fd
MD5 25010f9831703e6aaa3538eb569a264f
BLAKE2b-256 0d41b88ec6b58f358b8224369c2891ad813426ed2db4f022c2f5ca93b8bcfce2

See more details on using hashes here.

File details

Details for the file ModisDownload-2.0-py3-none-any.whl.

File metadata

  • Download URL: ModisDownload-2.0-py3-none-any.whl
  • Upload date:
  • Size: 13.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.7.8rc1

File hashes

Hashes for ModisDownload-2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 80f96b6bfd5969c62fdba8cb5fc7188760a5367eff8fe6b51e722ba4462fd3f9
MD5 4ac84b04724551f0cbc01ad6be7b9e83
BLAKE2b-256 8bd9018b13801a7f18ae684c7b1e524725bc9618a64807e40141d228e9228ad2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page