Search-Engine-Scraper
A module to scrape popular search engines
Capabilities
The very first version can do the following:
- Query and get results for google,bing and yahoo.
- Scrape 20 free proxies and randomly select one before querying the search engine.
- This scraping will happen after 15 minutes since the last scraping was done.
- Randomize an user agent for the query run.
Usage and Installation
Python 3.6+ is required
Install via pip:
pip install search-engine-scraper
Import the search engines as :
from search_engine_scraper import google_search,bing_search,yahoo_search
Run query as :
google_search.search("your text here , search for whatever you wish")
1 maintainer
Release files for search-engine-scraper 0.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| search_engine_scraper-0.4.tar.gz | 40.5 kB | Details |
Release files / search_engine_scraper-0.4.tar.gz
| Download URL | search_engine_scraper-0.4.tar.gz |
|---|---|
| Size | 40.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4023acff2a632588e1a14f2c9abb13449e41bf80465275f00f102ac73daeffe9
|
|
BLAKE2b-256 checksum How to use checksums |
cecb9ad4e53025894a22b4cae6c2de3c8a63766205c3cbf8dbbc8ae10c51167c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.5
|
