Skip to main content

GOOgle spiDER

Google search engine parser on python3

Instruction

Requirement python 3.10+

pip install gooder

from gooder import Gooder

gooder = Gooder()
# Make request on google.com/search?q=Hello+World
parsed = gooder.parse(query="Hello World")

# Print only result links
print(gooder.get_links())

# Print only result titles
print(gooder.get_titles())

# Print all results list[tuple[link,title]]
print(gooder.raw_results)

# If TRUE = parsed, else = captcha/rate limit
if (parsed)
    # Save urls to json file
    gooder.save_to_file(only_urls=True, to_json=True, override=True, file="results.json")

Methods & Fields

Method/Field Args Example Result
Gooder.parse query: str, page: int=0, ignore_google: bool=True, clear_old: bool=True gooder.parse("hello", clear_old=False) True | False
Gooder.raw_results Field Field [[link, title], ...]
Gooder.get_links repeats: bool = False gooder.get_links() [unique_link, ...]
Gooder.get_titles None gooder.get_titles() [title, title, ...]
Gooder.save_to_file only_urls: bool = True override: bool = True to_json: bool = False file: str = "urls.txt" gooder.save_to_file() New file with urls
Gooder.get_hostname links: str | list gooder.get_hostname(https://google.com/) google.com
Gooder.get_captcha_url None gooder.get_captcha_url() None | google.com/sorry/...
Gooder.get_headers None gooder.get_headers() None | HTTPHeaderDict({...})

Todo:

  • Add proxy manager
  • Replace raw_results: list(list()) to dict()

Release files for gooder 0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for gooder 0.3.1
File Size Uploaded
gooder-0.3.1.tar.gz 3.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for gooder 0.3.1
File Interpreter ABI Platform
gooder-0.3.1-py3-none-any.whl Python 3 none any Details

Total release size: 21.8 kB

Release files / gooder-0.3.1.tar.gz

Download URL gooder-0.3.1.tar.gz
Size 3.5 kB
Tags Source
SHA-256 checksum
How to use checksums
b1f5a166785aa751e1f5c59b9a9fe9570c4df1b550a0bed429566ddd9db444c8
BLAKE2b-256 checksum
How to use checksums
2ff49bbae94355a43ac5bab94d9a9e4d13bac0d8a605e2b247620b38a9fbeffe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.3 Windows/10

Release files / gooder-0.3.1-py3-none-any.whl

Download URL gooder-0.3.1-py3-none-any.whl
Size 18.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
b7fe0bd497969a0dc1d0dce2dc3c89777b31b9c0ae3a3260bd551fd497e40db9
BLAKE2b-256 checksum
How to use checksums
5289fdf97d345a1108040b60c6a61b0e9b8d649e487d3b8318c95ee293b056c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.3 Windows/10

Release history Release notifications | RSS feed

0.3.2

2 release files

This release

0.3.1 This release

2 release files

0.3.0

2 release files

0.2.1

2 release files

0.2

2 release files

0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page