pyselsearch

Get Google Search results using browser as requests sometimes sucks. It includes support for proxy authentication, headless browsing, and customizable search result parsing.

Features

• Headless and non-headless scraping
• Authenticated proxy support (username:password@host:port)
• Dynamic Chrome extension creation for proxy auth
• Undetected ChromeDriver (via SeleniumBase)
• CLI tool for quick usage

Installation

Clone the repository and install in editable mode:

pip install pyselsearch

Usage

Python

from pyselsearch.core import GoogleSearch

scrape = GoogleSearch(proxy="username:password@host:port")
results =scrape.search("OpenAI ChatGPT")

for result in results:
    print(result["title"], result["url"])

Command Line

pyselsearch "search query"

Additional options:

pyselsearch "search query" --headless --proxy "user:pass@host:port"

License

This project is licensed under the MIT License.