一个简单的支持多线程,断点续传及分布式的下载器。
Project description
downloader_cluster
==================
DESCRIPTION
-----------
- 一个简单的支持多线程,断点续传及分布式的下载器
INSTALL
-------
ubuntu
>>>>>>
::
git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install
or
sudo pip install downloader-cluster
USAGE
>>>>>
::
ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...
positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.
optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]
Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]
- demo1
::
- 普通下载
::
downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- 断点续传(服务器需要提供支持)
::
downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- demo2
- 分布式下载
- 向redis队列中发布下载任务
- 实现自定义分布式下载器
- 参见: test_
.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py
==================
DESCRIPTION
-----------
- 一个简单的支持多线程,断点续传及分布式的下载器
INSTALL
-------
ubuntu
>>>>>>
::
git clone https://github.com/ShichaoMa/downloader_cluster.git
sudo python setup.py install
or
sudo pip install downloader-cluster
USAGE
>>>>>
::
ubuntu@dev:~$ downloader -h
usage: downloader.py [-h] {start,reload} ...
positional arguments:
{start,reload}
start start download a file.
reload continue downlaod a file.
optional arguments:
-h, --help how this help message and exit
Command 'start'
usage: downloader.py start [-h] [-s SETTINGS] -u URL [-f FILENAME]
Command 'reload'
usage: downloader.py reload [-h] [-s SETTINGS] -u URL [-f FILENAME]
- demo1
::
- 普通下载
::
downloader start -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- 断点续传(服务器需要提供支持)
::
downloader reload -u "https://download.jetbrains.8686c.com/python/pycharm-community-2016.2.tar.gz" -f test.tar.gz
- demo2
- 分布式下载
- 向redis队列中发布下载任务
- 实现自定义分布式下载器
- 参见: test_
.. _test: https://github.com/ShichaoMa/downloader_cluster/blob/master/test/test.py