Make downloading scientific data much easier
Introduction
DataDownloader is a user-friendly package for downloading files using HTTP/HTTPS. It currently includes a downloader module for downloading files, a parse_urls module for parsing URLs, and a services module for managing well-known online services.
Highlight Features
DataDownloader has several features to make retrieving files easy, including:
- Resumable: You can resume aborted downloads automatically when you re-execute the code if website support resuming (status code is 216 or 416 when send a HEAD request to the server supplying a Range header)
- Asynchronous: Can download multiple files at the same time when download a single file very slow.
- Convenient: Provide a easy way to manage your username and password and parse urls from different sources:
- netrc: Provide a convenient way to manage your username and password via
.netrcfile, avoiding providing your login information over and over again. - parse_urls: Provide various methods to parse urls from different sources. See sections :ref:
parse_urlsfor more details - services: Provide a convenient way to manage well-known online services, currently support: HyP3, LiCSAR, Sentinel-1 orbit.
- netrc: Provide a convenient way to manage your username and password via
Installation
You can install DataDownloader via pip from PyPI:
pip install data_downloader
or you can install the latest version from GitHub:
pip install git+hhttps://github.com/Fanchengyan/data-downloader.git
Usage
The detailed documentation is available at: https://data-downloader.readthedocs.io/en/latest/.
1 maintainer
Metadata
1 maintainer
Release files for data-downloader 1.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| data_downloader-1.2.tar.gz | 26.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| data_downloader-1.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 54.8 kB
Release files / data_downloader-1.2.tar.gz
| Download URL | data_downloader-1.2.tar.gz |
|---|---|
| Size | 26.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2717cd444a8a63450c4229bf1b90b81007fd2108b512d3e99cec57e234e4ed08
|
|
BLAKE2b-256 checksum How to use checksums |
58c5f780436acfe577fa951ce998ee8bbfba232fa69e3cac69a68032aac59dc7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.9.19
|
Release files / data_downloader-1.2-py3-none-any.whl
| Download URL | data_downloader-1.2-py3-none-any.whl |
|---|---|
| Size | 28.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ad4924c57cad7f1a6f8ac2b6a487832719dc3b949b898b2d6511b3daecb3659c
|
|
BLAKE2b-256 checksum How to use checksums |
0e422dfdcf435a2e5dd19035bb81065b0e439bccd5b61df75a987bbdd12819f8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.9.19
|
