A Python library for scraping the Google search engine.
Project description
googlesearch
googlesearch is a Python library for searching Google, easily. googlesearch uses requests and BeautifulSoup4 to scrape Google.
Installation
To install, run the following command:
python3 -m pip install googlesearch-python
Usage
To get results for a search term, simply use the search function in googlesearch. For example, to get results for "Google" in Google, just run the following program:
from googlesearch import search
search("Google")
Additional options
googlesearch supports a few additional options. By default, googlesearch returns 10 results. This can be changed. To get a 100 results on Google for example, run the following program.
from googlesearch import search
search("Google", num_results=100)
In addition, you can change the language google searches in. For example, to get results in French run the following program:
from googlesearch import search
search("Google", lang="fr")
You can also specify the region (Country Codes) for your search results. For example, to get results specifically from the US run the following program:
from googlesearch import search
search("Google", region="us")
If you want to turn off the safe search function (this function is on by default), you can do this:
from googlesearch import search
search("Google", safe=None)
To extract more information, such as the description or the result URL, use an advanced search:
from googlesearch import search
search("Google", advanced=True)
# Returns a list of SearchResult
# Properties:
# - title
# - url
# - description
If requesting more than 100 results, googlesearch will send multiple requests to go through the pages. To increase the time between these requests, use sleep_interval
:
from googlesearch import search
search("Google", sleep_interval=5, num_results=200)
If you are using a HTTP Rotating Proxy which requires you to install their CA Certificate, you can simply add ssl_verify=False
in the search()
method to avoid SSL Verification.
from googlesearch import search
proxy = 'http://API:@proxy.host.com:8080/'
j = search("proxy test", num_results=100, lang="en", proxy=proxy, ssl_verify=False)
for i in j:
print(i)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for googlesearch_python-1.2.5.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c23488374f477fb36e8e2975abc5e4e18794d898d8a2c9c9bf21a1440213e87 |
|
MD5 | 772c461b0211046eb4d524a9274bfe1f |
|
BLAKE2b-256 | d469b285059d1e3ab119eb9fd072aa3fd9da8da8867296e3cee4349bd74c2d63 |
Hashes for googlesearch_python-1.2.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 28ef8ad737951b96ebe8963fbeb9bd2b45cae5c2533df1cc7cb8e72129a785f9 |
|
MD5 | a64b26172aa3ad8ffcabcdc3fed69e13 |
|
BLAKE2b-256 | 2e5c387b879de452c6c4b5400a52f1c0216aca3aa5740acfd93346f543a20133 |