Distributed Python web crawling framework
Project description
========
Dragline
========
[![PyPI version](https://badge.fury.io/py/Dragline.svg)](http://badge.fury.io/py/Dragline)
Dragline is a distributed Python web crawling framework.
Features :
---------
* Distributed, scalable and persistent crawling
* Efficient lightweight parallel execution based on gevent
* Redis backend for distributed and uninterrupted crawling
Requirements
------------
* Python 2.7
* Works on Linux
* Redis
Install
-------
The quick way :
pip install --pre dragline
Download the latest release from [Python Package Index] or clone [the repository].
[Python Package Index]: http://pypi.python.org/pypi/dragline
[the repository]: https://github.com/inzyte/dragline
Dragline
========
[![PyPI version](https://badge.fury.io/py/Dragline.svg)](http://badge.fury.io/py/Dragline)
Dragline is a distributed Python web crawling framework.
Features :
---------
* Distributed, scalable and persistent crawling
* Efficient lightweight parallel execution based on gevent
* Redis backend for distributed and uninterrupted crawling
Requirements
------------
* Python 2.7
* Works on Linux
* Redis
Install
-------
The quick way :
pip install --pre dragline
Download the latest release from [Python Package Index] or clone [the repository].
[Python Package Index]: http://pypi.python.org/pypi/dragline
[the repository]: https://github.com/inzyte/dragline
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Dragline-2.0.10.tar.gz
(17.6 kB
view hashes)
Built Distribution
Dragline-2.0.10-py2-none-any.whl
(23.9 kB
view hashes)
Close
Hashes for Dragline-2.0.10-py2-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d371366319e6532e8221aac11ca6cb83d6ed4c423a1cfdae95bc7c54179fbdfb |
|
MD5 | 8cdb54d52d3ce1ec265417ae7557e02e |
|
BLAKE2b-256 | 7bb8cf989775c9ac5b37bba1ed0375e9c3dde95f5eb73c2c0f11c68607a342f9 |