search-parser 0.0.1

Parse search engine HTML results into structured data

search-parser

Parse search engine HTML results into structured data (JSON, Markdown) with auto-detection.

search-parser takes raw HTML from popular search engines and extracts structured result data -- titles, URLs, snippets, and more -- into your preferred output format. It auto-detects the search engine from the HTML content, so you don't have to specify which parser to use.

---

Quick Start

from search_engine_parser import parse

html = open("google_results.html").read()

# JSON string
json_output = parse(html, output_format="json")
print(json_output)
# [{"title": "Example Result", "url": "https://example.com", "snippet": "An example result..."}, ...]

# Markdown string
md_output = parse(html, output_format="markdown")
print(md_output)
# ## Example Result
# **URL:** https://example.com
# An example result...

# Python list of dicts (default)
results = parse(html, output_format="dict")
for result in results:
    print(result["title"], result["url"])

---

Installation

With uv (recommended):

uv add search-parser

With pip:

pip install search-parser

---

Supported Search Engines

Search Engine	Auto-Detect	Status
Google	Yes	Stable
Bing	Yes	Stable
DuckDuckGo	Yes	Stable

Each parser extracts the following fields (when available):

• title -- The result heading
• url -- The link to the result page
• snippet -- The text preview / description
• position -- The result's rank on the page

---

Output Formats

JSON

[
  {
    "position": 1,
    "title": "Example Domain",
    "url": "https://example.com",
    "snippet": "This domain is for use in illustrative examples..."
  },
  {
    "position": 2,
    "title": "Another Result",
    "url": "https://another.example.com",
    "snippet": "Another example snippet text..."
  }
]

Markdown

## 1. Example Domain
**URL:** https://example.com
This domain is for use in illustrative examples...

---

## 2. Another Result
**URL:** https://another.example.com
Another example snippet text...

Dict (Python)

[
    {
        "position": 1,
        "title": "Example Domain",
        "url": "https://example.com",
        "snippet": "This domain is for use in illustrative examples...",
    },
    {
        "position": 2,
        "title": "Another Result",
        "url": "https://another.example.com",
        "snippet": "Another example snippet text...",
    },
]

---

CLI Usage

search-parser includes a command-line interface for quick parsing:

# Parse an HTML file to JSON (auto-detects search engine)
search-parser parse results.html --format json

# Parse with explicit engine
search-parser parse results.html --engine google --format markdown

# Read from stdin
cat results.html | search-parser parse - --format json

# Output to a file
search-parser parse results.html --format json --output results.json

---

Documentation

Full documentation is available at https://search-parser.github.io/search-parser/.

• Getting Started
• API Reference
• Adding a New Search Engine
• Examples

---

Contributing

Contributions are welcome! Please read our Contributing Guide for details on the development workflow, how to add new parsers, and how to submit pull requests.

---

License

This project is licensed under the Apache License 2.0. See the LICENSE file for details.