A module to scrape popular search engines
Project description
Search-Engine-Scraper
A module to scrape popular search engines
Capabilities
The very first version can do the following:
- Query and get results for google,bing and yahoo.
- Scrape 20 free proxies and randomly select one before querying the search engine.
- This scraping will happen after 15 minutes since the last scraping was done.
- Randomize an user agent for the query run.
Usage and Installation
Python 3.6+ is required
Install via pip:
pip install search-engine-scraper
Import the search engines as :
from search_engine_scraper import google_search,bing_search,yahoo_search
Run query as :
google_search.search("your text here , search for whatever you wish")
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
search_engine_scraper-0.4.tar.gz
(40.5 kB
view details)
File details
Details for the file search_engine_scraper-0.4.tar.gz.
File metadata
- Download URL: search_engine_scraper-0.4.tar.gz
- Upload date:
- Size: 40.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.41.1 CPython/3.7.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4023acff2a632588e1a14f2c9abb13449e41bf80465275f00f102ac73daeffe9
|
|
| MD5 |
25bbc79355fd9a6e4a2bad21e2c16d38
|
|
| BLAKE2b-256 |
cecb9ad4e53025894a22b4cae6c2de3c8a63766205c3cbf8dbbc8ae10c51167c
|
