Curate proxies from various sources in terms of latency. Supported on python 2.7.* and >3.4.
>> from letmecrawl import letmecrawl
>> for proxy in letmecrawl():
>> print(proxy)
88.99.11.10:6666Installation
pip install letmecrawlDocker
Use docker image as a http service:
docker pull montenegrodr/letmecrawl:latestRunning:
docker run -p 8000:8000 montenegrodr/letmecrawl:latestRequest proxy from top of the queue:
$ curl localhost:8000
{"proxy":"138.68.178.106:80"}
$ curl localhost:8000
{"proxy":"184.59.102.95:80"}1 maintainer
Release files for letmecrawl 0.13
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| letmecrawl-0.13.tar.gz | 4.5 kB | Details |
Release files / letmecrawl-0.13.tar.gz
| Download URL | letmecrawl-0.13.tar.gz |
|---|---|
| Size | 4.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1fa3745b8f43557e368edd468471e659db4bbe4e7236e4cca8f03c431c0fe860
|
|
BLAKE2b-256 checksum How to use checksums |
0e3ae80b974131c14e8f591cd6d0605abce18595de75d94d61b3fe9b510e0102
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.0.0 requests-toolbelt/0.8.0 tqdm/4.24.0 CPython/3.6.5
|
