Skip to main content

A Python library for scraping the Google search engine.

Project description

googlesearch

googlesearch is a Python library for searching Google, easily. googlesearch uses requests and BeautifulSoup4 to scrape Google.

Installation

To install, run the following command:

python3 -m pip install googlesearch-python

Usage

To get results for a search term, simply use the search function in googlesearch. For example, to get results for "Google" in Google, just run the following program:

from googlesearch import search
search("Google")

Additional options

googlesearch supports a few additional options. By default, googlesearch returns 10 results. This can be changed. To get a 100 results on Google for example, run the following program.

from googlesearch import search
search("Google", num_results=100)

In addition, you can change the language google searches in. For example, to get results in French run the following program:

from googlesearch import search
search("Google", lang="fr")

You can also specify the region (Country Codes) for your search results. For example, to get results specifically from the US run the following program:

from googlesearch import search
search("Google", region="us")

If you want to turn off the safe search function (this function is on by default), you can do this:

from googlesearch import search
search("Google", safe=None)

To extract more information, such as the description or the result URL, use an advanced search:

from googlesearch import search
search("Google", advanced=True)
# Returns a list of SearchResult
# Properties:
# - title
# - url
# - description

If requesting more than 100 results, googlesearch will send multiple requests to go through the pages. To increase the time between these requests, use sleep_interval:

from googlesearch import search
search("Google", sleep_interval=5, num_results=200)

If you are using a HTTP Rotating Proxy which requires you to install their CA Certificate, you can simply add ssl_verify=False in the search() method to avoid SSL Verification.

from googlesearch import search

proxy = 'http://API:@proxy.host.com:8080/'

j = search("proxy test", num_results=100, lang="en", proxy=proxy, ssl_verify=False)
for i in j:
    print(i)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

googlesearch_python-1.2.5.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

googlesearch_python-1.2.5-py3-none-any.whl (4.8 kB view details)

Uploaded Python 3

File details

Details for the file googlesearch_python-1.2.5.tar.gz.

File metadata

  • Download URL: googlesearch_python-1.2.5.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.12.4

File hashes

Hashes for googlesearch_python-1.2.5.tar.gz
Algorithm Hash digest
SHA256 3c23488374f477fb36e8e2975abc5e4e18794d898d8a2c9c9bf21a1440213e87
MD5 772c461b0211046eb4d524a9274bfe1f
BLAKE2b-256 d469b285059d1e3ab119eb9fd072aa3fd9da8da8867296e3cee4349bd74c2d63

See more details on using hashes here.

File details

Details for the file googlesearch_python-1.2.5-py3-none-any.whl.

File metadata

File hashes

Hashes for googlesearch_python-1.2.5-py3-none-any.whl
Algorithm Hash digest
SHA256 28ef8ad737951b96ebe8963fbeb9bd2b45cae5c2533df1cc7cb8e72129a785f9
MD5 a64b26172aa3ad8ffcabcdc3fed69e13
BLAKE2b-256 2e5c387b879de452c6c4b5400a52f1c0216aca3aa5740acfd93346f543a20133

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page