Skip to main content

Token-efficient web content extraction for LLM agents

Project description

BotBrowser (Python)

Token-efficient web content extraction for LLM agents.

Install

pip install botbrowser

Usage

from botbrowser import extract

result = extract("https://example.com")

print(result.content)                          # clean markdown
print(result.metadata.token_savings_percent)   # e.g. 94
print(result.title)                            # page title
print(result.links)                            # extracted links

Options

result = extract(
    "https://example.com",
    format="text",          # "markdown" (default) or "text"
    timeout=10000,          # request timeout in ms (default: 15000)
    include_links=False,    # extract links (default: True)
)

Client Mode

If you're running the BotBrowser REST API server, you can use the client:

from botbrowser import BotBrowserClient

client = BotBrowserClient("http://localhost:3000")
result = client.extract("https://example.com")

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

botbrowser-0.1.0.tar.gz (7.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

botbrowser-0.1.0-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file botbrowser-0.1.0.tar.gz.

File metadata

  • Download URL: botbrowser-0.1.0.tar.gz
  • Upload date:
  • Size: 7.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for botbrowser-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0912fc894ec41b8012a149f8a48f62e84958392ff48e66762907b27f3d283ec9
MD5 c80138d19452356102a99a95b15931a7
BLAKE2b-256 2256682bf1199e9d10249e299ab014a39b6e9ec3621193a71a41d495c23e81cf

See more details on using hashes here.

Provenance

The following attestation bundles were made for botbrowser-0.1.0.tar.gz:

Publisher: publish-pypi.yml on AmplifyCo/botbrowser

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file botbrowser-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: botbrowser-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 8.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for botbrowser-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7b6a366bcf68375ca5805a46d9827b65669308b6f4c09e7222a121843a8358bc
MD5 7b0dbb696cabbdfe4fe2a8b9b974d8c8
BLAKE2b-256 726313df11ded116765e08a267f88a25757fa2e94b673b66a6dfd8fa4ce30c4b

See more details on using hashes here.

Provenance

The following attestation bundles were made for botbrowser-0.1.0-py3-none-any.whl:

Publisher: publish-pypi.yml on AmplifyCo/botbrowser

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page