ainfo 0.1.0

Add your description here

ainfo

gather structured information from any website - ready for LLMs

Architecture

The project separates concerns into distinct modules:

• fetching – obtain raw data from a source
• parsing – transform raw data into a structured form
• extraction – pull relevant information from the parsed data
• output – handle presentation of the extracted results

Usage

Install the project and run the CLI against a URL:

pip install -e .
ainfo run https://example.com

The command fetches the page, parses its content and prints any emails, phone numbers or addresses that were detected.

To delegate information extraction or summarisation to an LLM, provide an OpenRouter API key via the OPENROUTER_API_KEY environment variable and pass --use-llm or --summarize:

export OPENROUTER_API_KEY=your_key
ainfo run https://example.com --use-llm --summarize

If the target site relies on client-side JavaScript, enable rendering with a headless browser:

ainfo run https://example.com --render-js

To crawl multiple pages starting from a URL and extract contact details from each one:

ainfo crawl https://example.com --depth 2

The crawler visits pages breadth-first up to the specified depth and prints results for every page encountered.

Both commands accept --render-js to execute JavaScript before scraping, which uses Playwright. Installing the browser drivers may require running playwright install.

Environment configuration

Copy .env.example to .env and populate it with your OpenRouter credentials to enable LLM-powered features.

Limitations

• Crawling retrieves each page twice: once for discovery and once for extraction, which may impact performance on large sites.
• Extraction focuses on basic contact details; more extractors can be added.