GOOgle spiDER
Google search engine parser on python3
Instruction
Requirement python 3.10+
pip install gooder
from gooder import Gooder
gooder = Gooder()
# Make request on google.com/search?q=Hello+World
parsed = gooder.parse(query="Hello World")
# Print only result links
print(gooder.get_links())
# Print only result titles
print(gooder.get_titles())
# Print all results list[tuple[link,title]]
print(gooder.raw_results)
# If TRUE = parsed, else = captcha/rate limit
if (parsed)
# Save urls to json file
gooder.save_to_file(only_urls=True, to_json=True, override=True, file="results.json")
Methods & Fields
| Method/Field | Args | Example | Result |
|---|---|---|---|
| Gooder.parse | query: str, page: int=0, ignore_google: bool=True, clear_old: bool=True | gooder.parse("hello", clear_old=False) | True | False |
| Gooder.raw_results | Field | Field | [[link, title], ...] |
| Gooder.get_links | repeats: bool = False | gooder.get_links() | [unique_link, ...] |
| Gooder.get_titles | None | gooder.get_titles() | [title, title, ...] |
| Gooder.save_to_file | only_urls: bool = True override: bool = True to_json: bool = False file: str = "urls.txt" | gooder.save_to_file() | New file with urls |
| Gooder.get_hostname | links: str | list | gooder.get_hostname(https://google.com/) | google.com |
| Gooder.get_captcha_url | None | gooder.get_captcha_url() | None | google.com/sorry/... |
| Gooder.get_headers | None | gooder.get_headers() | None | HTTPHeaderDict({...}) |
Todo:
- Add proxy manager
- Replace
raw_results: list(list())todict()
Metadata
Release files for gooder 0.3.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| gooder-0.3.2.tar.gz | 3.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| gooder-0.3.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 21.8 kB
Release files / gooder-0.3.2.tar.gz
| Download URL | gooder-0.3.2.tar.gz |
|---|---|
| Size | 3.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
904758e1446fbb9837953f5ff11735a10cf4ea5aa6fcaf74ed6858593837a1ee
|
|
BLAKE2b-256 checksum How to use checksums |
14419d68019b0a0e7661d64e2a7a955299de1d01d7e444d7c2c5a2e5118cd39a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.13 CPython/3.10.3 Windows/10
|
Release files / gooder-0.3.2-py3-none-any.whl
| Download URL | gooder-0.3.2-py3-none-any.whl |
|---|---|
| Size | 18.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
51b3fd2af314edc58d19636f3baaeceeb09f0fcf76a4cd6bf3d8ff6458458c34
|
|
BLAKE2b-256 checksum How to use checksums |
61ba286d24108dfd40688fa57a7d653f93cffd49a2506b916cb06e4c5a5b7b39
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.13 CPython/3.10.3 Windows/10
|