Skip to main content
Join the official Python Developers Survey 2018 and win valuable prizes: Start the survey!

一个简单的支持多线程,断点续传及分布式的下载器。

Project description

downloader_cluster
==================
DESCRIPTION
-----------
- 一个简单的支持多线程,断点续传及分布式的下载器
INSTALL
-------
ubuntu
>>>>>>
::

git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install

or

sudo pip install downloader-cluster

USAGE
>>>>>
::

ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...

positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.

optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]

Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]

- demo1
::

- 普通下载
::

downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- 断点续传(服务器需要提供支持)
::

downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz

- demo2
- 分布式下载
- 向redis队列中发布下载任务
- 实现自定义分布式下载器
- 参见: test_
.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
downloader-cluster-1.0.6.tar.gz (7.3 kB) Copy SHA256 hash SHA256 Source None Dec 17, 2016

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page