A Python library for scraping the Google search engine.
Project description
googlesearch
googlesearch is a Python library for searching Google, easily. googlesearch uses requests and BeautifulSoup4 to scrape Google.
Installation
To install, run the following command:
python3 -m pip install googlesearch-python
Usage
To get results for a search term, simply use the search function in googlesearch. For example, to get results for "Google" in Google, just run the following program:
from googlesearch import search
search("Google")
Additional options
googlesearch supports a few additional options. By default, googlesearch returns 10 results. This can be changed. To get a 100 results on Google for example, run the following program.
from googlesearch import search
search("Google", num_results=100)
In addition, you can change the language google searches in. For example, to get results in French run the following program:
from googlesearch import search
search("Google", lang="fr")
You can also specify the region (Country Codes) for your search results. For example, to get results specifically from the US run the following program:
from googlesearch import search
search("Google", region="us")
If you want to turn off the safe search function (this function is on by default), you can do this:
from googlesearch import search
search("Google", safe=None)
To extract more information, such as the description or the result URL, use an advanced search:
from googlesearch import search
search("Google", advanced=True)
# Returns a list of SearchResult
# Properties:
# - title
# - url
# - description
If requesting more than 100 results, googlesearch will send multiple requests to go through the pages. To increase the time between these requests, use sleep_interval
:
from googlesearch import search
search("Google", sleep_interval=5, num_results=200)
If you are using a HTTP Rotating Proxy which requires you to install their CA Certificate, you can simply add ssl_verify=False
in the search()
method to avoid SSL Verification.
from googlesearch import search
proxy = 'http://API:@proxy.host.com:8080/'
j = search("proxy test", num_results=100, lang="en", proxy=proxy, ssl_verify=False)
for i in j:
print(i)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file googlesearch_python-1.2.5.tar.gz
.
File metadata
- Download URL: googlesearch_python-1.2.5.tar.gz
- Upload date:
- Size: 4.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c23488374f477fb36e8e2975abc5e4e18794d898d8a2c9c9bf21a1440213e87 |
|
MD5 | 772c461b0211046eb4d524a9274bfe1f |
|
BLAKE2b-256 | d469b285059d1e3ab119eb9fd072aa3fd9da8da8867296e3cee4349bd74c2d63 |
File details
Details for the file googlesearch_python-1.2.5-py3-none-any.whl
.
File metadata
- Download URL: googlesearch_python-1.2.5-py3-none-any.whl
- Upload date:
- Size: 4.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 28ef8ad737951b96ebe8963fbeb9bd2b45cae5c2533df1cc7cb8e72129a785f9 |
|
MD5 | a64b26172aa3ad8ffcabcdc3fed69e13 |
|
BLAKE2b-256 | 2e5c387b879de452c6c4b5400a52f1c0216aca3aa5740acfd93346f543a20133 |