Skip to main content

一个简单的支持多线程,断点续传及分布式的下载器。

Project description

downloader_cluster
==================
DESCRIPTION
-----------
- 一个简单的支持多线程,断点续传及分布式的下载器
INSTALL
-------
ubuntu
>>>>>>
::

git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install

or

sudo pip install downloader-cluster

USAGE
>>>>>
::

ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...

positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.

optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]

Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]

- demo1
::

- 普通下载
::

downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- 断点续传(服务器需要提供支持)
::

downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz

- demo2
- 分布式下载
- 向redis队列中发布下载任务
- 实现自定义分布式下载器
- 参见: test_
.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

downloader-cluster-1.0.6.tar.gz (7.3 kB view details)

Uploaded Source

File details

Details for the file downloader-cluster-1.0.6.tar.gz.

File metadata

File hashes

Hashes for downloader-cluster-1.0.6.tar.gz
Algorithm Hash digest
SHA256 22451a9bf3967ece0b0c43582a16f12a1edd27f5e3b3bd28f0db71b8d5c0cfd0
MD5 51bc84de56a44af73b9ffbe6ee88a4de
BLAKE2b-256 2015496a67d547217f68afc495da3bdb62940057dc50c0b152443466254b88c4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page