A Python library for scraping the Google search engine.
Project description
googlesearch
googlesearch is a Python library for searching Google, easily. googlesearch uses requests and BeautifulSoup4 to scrape Google.
Installation
To install, run the following command:
python3 -m pip install googlesearch-python
Usage
To get results for a search term, simply use the search function in googlesearch. For example, to get results for "Google" in Google, just run the following program:
from googlesearch import search
search("Google")
Additional options
googlesearch supports a few additional options. By default, googlesearch returns 10 results. This can be changed. To get a 100 results on Google for example, run the following program.
from googlesearch import search
search("Google", num_results=100)
In addition, you can change the language google searches in. For example, to get results in French run the following program:
from googlesearch import search
search("Google", lang="fr")
If you want to turn off the safe search function (this function is on by default), you can do this:
from googlesearch import search
search("Google", safe=None)
To extract more information, such as the description or the result URL, use an advanced search:
from googlesearch import search
search("Google", advanced=True)
# Returns a list of SearchResult
# Properties:
# - title
# - url
# - description
If requesting more than 100 results, googlesearch will send multiple requests to go through the pages. To increase the time between these requests, use sleep_interval
:
from googlesearch import search
search("Google", sleep_interval=5, num_results=200)
If you are using a HTTP Rotating Proxy which requires you to install their CA Certificate, you can simply add ssl_verify=False
in the search()
method to avoid SSL Verification.
from googlesearch import search
proxy = 'http://API:@proxy.host.com:8080/'
j = search("proxy test", num_results=100, lang="en", proxy=proxy, ssl_verify=False)
for i in j:
print(i)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for googlesearch_python-1.2.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed0a53780b22f2fd551e1ebe1d6e81436b7bc016def3882206c823663a5e1c02 |
|
MD5 | 6b1d8af9cf7fcf0c35af8fab8ce8d62c |
|
BLAKE2b-256 | 9eb3bc157f87387e8fbcce1a381ec703da9187352cf05f5b70166fb00eaa47b0 |
Hashes for googlesearch_python-1.2.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1041de585d6042d6ae069c4aae7cf3ac7011e7726d7523012a4d30f5e4f70958 |
|
MD5 | e7bb4980bf97c305413e6e54e14e55c2 |
|
BLAKE2b-256 | 076dbc3f2246868c29f1eacceed738057a7ea3c2b04737822b7fcc10128722b5 |