A module to scrape popular search engines
Project description
Search-Engine-Scraper
A module to scrape popular search engines
Capabilities
The very first version can do the following:
- Query and get results for google,bing and yahoo.
- Scrape 20 free proxies and randomly select one before querying the search engine.
- This scraping will happen after 15 minutes since the last scraping was done.
- Randomize an user agent for the query run.
Usage and Installation
Python 3.6+ is required
Install via pip:
pip install search-engine-scraper
Import the search engines as :
from search_engine_scraper import google_search,bing_search,yahoo_search
Run query as :
google_search.search("your text here , search for whatever you wish")
Release history Release notifications
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size search_engine_scraper-0.4.tar.gz (40.5 kB) | File type Source | Python version None | Upload date | Hashes View hashes |
Close
Hashes for search_engine_scraper-0.4.tar.gz
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 4023acff2a632588e1a14f2c9abb13449e41bf80465275f00f102ac73daeffe9 |
|
| MD5 | 25bbc79355fd9a6e4a2bad21e2c16d38 |
|
| BLAKE2-256 | cecb9ad4e53025894a22b4cae6c2de3c8a63766205c3cbf8dbbc8ae10c51167c |
