GOOgle spiDER
Google search engine parser on python3
Instruction
Requirement python 3.10+
pip install gooder
from gooder import Gooder
gooder = Gooder()
# Make request on google.com/search?q=Hello+World
parsed = gooder.parse(query="Hello World")
# Print only result links
print(gooder.get_links())
# Print only result titles
print(gooder.get_titles())
# Print all results list[tuple[link,title]]
print(gooder.raw_results)
# If TRUE = parsed, else = captcha/rate limit
if (parsed)
# Save urls to json file
gooder.save_to_file(only_urls=True, to_json=True, override=True, file="results.json")
Methods & Fields
| Method/Field | Args | Example | Result |
|---|---|---|---|
| Gooder.parse | query: str, page: int=0, ignore_google: bool=True, clear_old: bool=True | gooder.parse("hello", clear_old=False) | True | False |
| Gooder.raw_results | Field | Field | [[link, title], ...] |
| Gooder.get_links | repeats: bool = False | gooder.get_links() | [unique_link, ...] |
| Gooder.get_titles | None | gooder.get_titles() | [title, title, ...] |
| Gooder.save_to_file | only_urls: bool = True override: bool = True to_json: bool = False file: str = "urls.txt" | gooder.save_to_file() | New file with urls |
| Gooder.get_hostname | links: str | list | gooder.get_hostname(https://google.com/) | google.com |
| Gooder.get_captcha_url | None | gooder.get_captcha_url() | None | google.com/sorry/... |
| Gooder.get_headers | None | gooder.get_headers() | None | HTTPHeaderDict({...}) |
Todo:
- Add proxy manager
- Replace
raw_results: list(list())todict()
Release files for gooder 0.3.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| gooder-0.3.1.tar.gz | 3.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| gooder-0.3.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 21.8 kB
Release files / gooder-0.3.1.tar.gz
| Download URL | gooder-0.3.1.tar.gz |
|---|---|
| Size | 3.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b1f5a166785aa751e1f5c59b9a9fe9570c4df1b550a0bed429566ddd9db444c8
|
|
BLAKE2b-256 checksum How to use checksums |
2ff49bbae94355a43ac5bab94d9a9e4d13bac0d8a605e2b247620b38a9fbeffe
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.13 CPython/3.10.3 Windows/10
|
Release files / gooder-0.3.1-py3-none-any.whl
| Download URL | gooder-0.3.1-py3-none-any.whl |
|---|---|
| Size | 18.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b7fe0bd497969a0dc1d0dce2dc3c89777b31b9c0ae3a3260bd551fd497e40db9
|
|
BLAKE2b-256 checksum How to use checksums |
5289fdf97d345a1108040b60c6a61b0e9b8d649e487d3b8318c95ee293b056c8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.13 CPython/3.10.3 Windows/10
|