LlamaIndex Tools Integration: Olostep

Olostep is web scraping, crawling, and search infrastructure built for AI agents. This tool gives a LlamaIndex agent live web access — scrape any URL to clean markdown, run a web search, get an AI-grounded answer with sources, and crawl a website.

To get started, get an API key from the Olostep dashboard.

Installation

pip install llama-index-tools-olostep

Usage

Here's an example usage of the OlostepToolSpec:

from llama_index.tools.olostep import OlostepToolSpec
from llama_index.core.agent.workflow import FunctionAgent
from llama_index.llms.openai import OpenAI

olostep_tool = OlostepToolSpec(
    api_key="your-olostep-api-key",
)

agent = FunctionAgent(
    tools=olostep_tool.to_tool_list(),
    llm=OpenAI(model="gpt-4o"),
)

await agent.run("Scrape https://example.com and summarize the main heading")

Available tools

• scrape — Scrape a single URL and return its content as clean markdown.
• search — Search the web for a query and return the ranked results.
• answer — Get an AI-grounded answer to a question, synthesized from live web sources with citations.
• crawl — Crawl a website starting from a URL and return the pages' content.

This tool has a more extensive example usage documented in a Jupyter notebook here.