Distributed Python web crawling framework
Project description
========
Dragline
========
[](http://badge.fury.io/py/Dragline)
Dragline is a distributed Python web crawling framework.
Features :
---------
* Distributed, scalable and persistent crawling
* Efficient lightweight parallel execution based on gevent
* Redis backend for distributed and uninterrupted crawling
Requirements
------------
* Python 2.7
* Works on Linux
* Redis
Install
-------
The quick way :
pip install --pre dragline
Download the latest release from [Python Package Index] or clone [the repository].
[Python Package Index]: http://pypi.python.org/pypi/dragline
[the repository]: https://github.com/inzyte/dragline
Dragline
========
[](http://badge.fury.io/py/Dragline)
Dragline is a distributed Python web crawling framework.
Features :
---------
* Distributed, scalable and persistent crawling
* Efficient lightweight parallel execution based on gevent
* Redis backend for distributed and uninterrupted crawling
Requirements
------------
* Python 2.7
* Works on Linux
* Redis
Install
-------
The quick way :
pip install --pre dragline
Download the latest release from [Python Package Index] or clone [the repository].
[Python Package Index]: http://pypi.python.org/pypi/dragline
[the repository]: https://github.com/inzyte/dragline
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Dragline-0.10.3b2.tar.gz
(14.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file Dragline-0.10.3b2.tar.gz.
File metadata
- Download URL: Dragline-0.10.3b2.tar.gz
- Upload date:
- Size: 14.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
546207e7af591b448fde590906b4b5adc8c314c9a80753800bdcfe9aef0509cf
|
|
| MD5 |
7916dc396696a0fedd592cb3591de205
|
|
| BLAKE2b-256 |
3de9aabe953f0350c7f8a803158945edc8c8b09ddc5ea07a8e060504fbc7c2fd
|
File details
Details for the file Dragline-0.10.3b2-py2-none-any.whl.
File metadata
- Download URL: Dragline-0.10.3b2-py2-none-any.whl
- Upload date:
- Size: 18.7 kB
- Tags: Python 2
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
76c8d9c32ac41129f504f38fe3355e09982625d22c7b9657710f5400a70ebabd
|
|
| MD5 |
27ff765255661c1bd46d59ececae3fec
|
|
| BLAKE2b-256 |
a1ab385d504f33685c1c976c180fb0f8aaf6e54e00283a3f57358a794179b914
|
