Skip to main content

GOOgle spiDER

Google search engine parser on python3

Instruction

Requirement python 3.10+

pip install gooder

from gooder import Gooder

gooder = Gooder()
# Make request on google.com/search?q=Hello+World
parsed = gooder.parse(query="Hello World")

# Print only result links
print(gooder.get_links())

# Print only result titles
print(gooder.get_titles())

# Print all results list[tuple[link,title]]
print(gooder.raw_results)

# If TRUE = parsed, else = captcha/rate limit
if (parsed)
    # Save urls to json file
    gooder.save_to_file(only_urls=True, to_json=True, override=True, file="results.json")

Methods & Fields

Method/Field Args Example Result
Gooder.parse query: str, page: int=0, ignore_google: bool=True, clear_old: bool=True gooder.parse("hello", clear_old=False) True | False
Gooder.raw_results Field Field [[link, title], ...]
Gooder.get_links repeats: bool = False gooder.get_links() [unique_link, ...]
Gooder.get_titles None gooder.get_titles() [title, title, ...]
Gooder.save_to_file only_urls: bool = True override: bool = True to_json: bool = False file: str = "urls.txt" gooder.save_to_file() New file with urls
Gooder.get_hostname links: str | list gooder.get_hostname(https://google.com/) google.com
Gooder.get_captcha_url None gooder.get_captcha_url() None | google.com/sorry/...
Gooder.get_headers None gooder.get_headers() None | HTTPHeaderDict({...})

Todo:

  • Add proxy manager
  • Replace raw_results: list(list()) to dict()

Metadata

Release files for gooder 0.3.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for gooder 0.3.2
File Size Uploaded
gooder-0.3.2.tar.gz 3.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for gooder 0.3.2
File Interpreter ABI Platform
gooder-0.3.2-py3-none-any.whl Python 3 none any Details

Total release size: 21.8 kB

Release files / gooder-0.3.2.tar.gz

Download URL gooder-0.3.2.tar.gz
Size 3.5 kB
Tags Source
SHA-256 checksum
How to use checksums
904758e1446fbb9837953f5ff11735a10cf4ea5aa6fcaf74ed6858593837a1ee
BLAKE2b-256 checksum
How to use checksums
14419d68019b0a0e7661d64e2a7a955299de1d01d7e444d7c2c5a2e5118cd39a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.3 Windows/10

Release files / gooder-0.3.2-py3-none-any.whl

Download URL gooder-0.3.2-py3-none-any.whl
Size 18.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
51b3fd2af314edc58d19636f3baaeceeb09f0fcf76a4cd6bf3d8ff6458458c34
BLAKE2b-256 checksum
How to use checksums
61ba286d24108dfd40688fa57a7d653f93cffd49a2506b916cb06e4c5a5b7b39
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.13 CPython/3.10.3 Windows/10

Release history Release notifications | RSS feed

This release

0.3.2 This release

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.1

2 release files

0.2

2 release files

0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page