This library contains many useful function which will speed up the making of scrappers. The library focusses on efforts to ensure that the scrappers don't get blocked by the servers. It has functions which:
- Returns a random user agent out of 10,000 user agents. The user agents are stored in a csv file inside the package.
- Randomly hit various URLs provided by the users
- Raise Alert in the form of e-mail and/or beeps
1 maintainer
Metadata
1 maintainer
Release files for scrapper-cf 1.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapper-cf-1.0.6.tar.gz | 714.7 kB | Details |
Release files / scrapper-cf-1.0.6.tar.gz
| Download URL | scrapper-cf-1.0.6.tar.gz |
|---|---|
| Size | 714.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9c17afdb51b2af5450a45705d928115b6e70253bf38f8a33a801091c5348f04e
|
|
BLAKE2b-256 checksum How to use checksums |
556390aa5bd93a64300952a549a82c69fa05ba24e2724da2422d86a0256a98ca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.6.1 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.9.1 tqdm/4.54.1 CPython/3.8.5
|
