A module to scrape popular search engines
Project description
Search-Engine-Scraper
A module to scrape popular search engines
Capabilities
The very first version can do the following:
- Query and get results for google,bing and yahoo.
- Scrape 20 free proxies and randomly select one before querying the search engine.
- This scraping will happen after 15 minutes since the last scraping was done.
- Randomize an user agent for the query run.
Usage and Installation
Python 3.6+ is required
Install via pip:
pip install search_engine_scraper
Import the search engines as :
from search_engine_scraper import google_search,bing_search,yahoo_search
Run query as :
google_search.search("your text here , search for whatever you wish")
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
search_engine_scraper-0.3.tar.gz
(40.5 kB
view hashes)
Close
Hashes for search_engine_scraper-0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ece5dcb1663d8b35e82048737fdadc61bb41b5aed9b5bfff5927610da6290a91 |
|
MD5 | d53b13e5a506964e0d7c19042cf6002a |
|
BLAKE2b-256 | 5c674be919a12b1227bc79b1bb9b90d4c09d12d0a09e158ef5d43a7a662f24cc |