Skip to main content

一个简单的支持多线程,断点续传及分布式的下载器。

Project description

downloader_cluster
==================
DESCRIPTION
-----------
- 一个简单的支持多线程,断点续传及分布式的下载器
INSTALL
-------
ubuntu
>>>>>>
::

git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install

or

sudo pip install downloader-cluster

USAGE
>>>>>
::

ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...

positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.

optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]

Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]

- demo1
::

- 普通下载
::

downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- 断点续传(服务器需要提供支持)
::

downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz

- demo2
- 分布式下载
- 向redis队列中发布下载任务
- 实现自定义分布式下载器
- 参见: test_
.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

downloader-cluster-1.0.3.zip (12.9 kB view details)

Uploaded Source

downloader-cluster-1.0.3.tar.gz (7.1 kB view details)

Uploaded Source

File details

Details for the file downloader-cluster-1.0.3.zip.

File metadata

File hashes

Hashes for downloader-cluster-1.0.3.zip
Algorithm Hash digest
SHA256 eb5444f276b770ee01d905c00288bf83d3ca54f3822f84cc087f29460f98af31
MD5 27b0de0af944162dcc2f85aa869b3652
BLAKE2b-256 9f6ebcbc24657fa6ed5dcabdc0dc6090f7687d9c86fd53840644686f222cdf2b

See more details on using hashes here.

File details

Details for the file downloader-cluster-1.0.3.tar.gz.

File metadata

File hashes

Hashes for downloader-cluster-1.0.3.tar.gz
Algorithm Hash digest
SHA256 56ded6748ca7cea4606452823ae8fc03a811c232d7af3a16ed3888de4c281ba8
MD5 d5bc314e4797e9bf92f596469893104b
BLAKE2b-256 af38eb699976ad2a65f6c488a51e1a9c5fbd6e1a853a288d0c99cf9be838d6c4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page