tarzi 0.1.5

Rust-native lite search for AI applications

tarzi

⚠️ Current Limitation: Currently only search engines without anti-bot protection are workable, such as DuckDuckGo and Brave. We require advanced features to bypass anti-bot measures for other engines like Google and Bing.

🐒 Tarzi

Tarzi is a unified search interface designed for Retrieval-Augmented Generation (RAG) and agentic systems built on large language models. Search is a core functionality in these systems, yet most search engine providers (SEPs) impose API paywalls or strict rate limits. Tarzi, empowered by browser automation and web crawling technologies, removes these barriers by supporting token-free queries across multiple search engines. With a single dependency, you can integrate and switch between different SEPs as needed—seamlessly and efficiently.

⚙️ Core Capabilities

• 🦀 Dual Implementation: Native Rust library and Python wrapper with CLI tools
• 🔄 Content Conversion: Convert raw HTML into Markdown, JSON, or YAML, which is ready for LLMs
• 🔍 Search Integration: Fetch fully rendered result pages with a unified interface for token-free headless browser mode
• 🧠 Multi-Engine Support: Works with Bing, Google, DuckDuckGo, Baidu etc.
• 🛡️ Proxy Support: Bypass network bans using proxy support to access global SEPs
• 🚀 End-to-End Workflow: Full pipeline from search to content extraction for AI and automation use cases

🧪 Advanced Features (Under dev.)

• 🕵️‍♂️ Anti-Bot Evasion: Use fingerprint spoofing, proxy rotation, and human-like actions to avoid detection
• 🧠 Smarter Queries: Improve search results with prompt rewriting and intent-aware queries
• 🔗 Workflow Automation: Chain steps like search, click, form fill, and scraping into automated flows

Install

pip install tarzi

CLI Commands

Tarzi provides two command-line interfaces:

• tarzi: Native Rust CLI (faster, more efficient)
• pytarzi: Python CLI (easier to extend, same functionality)

Both CLIs support the same commands and configuration precedence.

Usage Examples

• Examples in Python and Rust: examples

Alternatives

• LangChain PlayWrightBrowserToolkit

Contributors

Thank you ❤ all human and non-human contributors.