Make downloading scientific data much easier
Project description
Make downloading scientific data much easier
Introduction
DataDownloader is a user-friendly package for downloading files using HTTP/HTTPS. It currently includes a downloader
module for downloading files, a parse_urls
module for parsing URLs, and a services
module for managing well-known online services.
Highlight Features
DataDownloader has several features to make retrieving files easy, including:
- Resumable: You can resume aborted downloads automatically when you re-execute the code if website support resuming (status code is 216 or 416 when send a HEAD request to the server supplying a Range header)
- Asynchronous: Can download multiple files at the same time when download a single file very slow.
- Convenient: Provide a easy way to manage your username and password and parse urls from different sources:
- netrc: Provide a convenient way to manage your username and password via
.netrc
file, avoiding providing your login information over and over again. - parse_urls: Provide various methods to parse urls from different sources. See sections :ref:
parse_urls
for more details - services: Provide a convenient way to manage well-known online services, currently support: HyP3, LiCSAR, Sentinel-1 orbit.
- netrc: Provide a convenient way to manage your username and password via
Installation
You can install DataDownloader
via pip from PyPI:
pip install data_downloader
or you can install the latest version from GitHub:
pip install git+hhttps://github.com/Fanchengyan/data-downloader.git
Usage
The detailed documentation is available at: https://data-downloader.readthedocs.io/en/latest/
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
data_downloader-1.1.tar.gz
(21.3 kB
view hashes)
Built Distribution
Close
Hashes for data_downloader-1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41b665fd7c73edaa198539b1a752150998da8a15ff2fb59955e7e03b6cdf856c |
|
MD5 | 7571ae1d1810f90ce04f9f37ada4c611 |
|
BLAKE2b-256 | 68c3e8fbaa6b85ba8ebad2cdfbaf7f3c0c7dd17b9fab7ce9a7f4f5b409761b4e |