Skip to main content

Bright Data web data tools for Hermes Agent — search, scrape, structured datasets, and browser automation

Project description

hermes-brightdata

CI PyPI version Python License: MIT

Bright Data web data tools for Hermes Agent — search, scrape, structured datasets, and browser automation.

Overview

This plugin integrates Bright Data's web data APIs with Hermes, providing nine powerful tools for web data collection:

  • Search & Scraping: Real-time search, single/batch URL scraping, and structured data extraction
  • Browser Automation: Interactive browser sessions with persistent cookies and JavaScript rendering
  • Bypass Detection: Automatic handling of bot detection, CAPTCHAs, and JavaScript-heavy sites

Bright Data handles all the complexity — proxy rotation, header management, retry logic, and content parsing.

Installation

Install the plugin with base tools:

pip install hermes-brightdata

To enable browser automation tools, install with the [browser] extra:

pip install hermes-brightdata[browser]

The browser extra adds Playwright for interactive session handling (required for browser_navigate, browser_snapshot, browser_act, browser_get).

Configuration

Before using any Bright Data tool, set your API credentials in environment variables:

Required

BRIGHTDATA_API_TOKEN (required, secret)

  • Your Bright Data API token
  • Obtain from Account Settings → API keys in the Bright Data dashboard
  • BRIGHTDATA_API_KEY is accepted as an alias if BRIGHTDATA_API_TOKEN is unset

Optional

BRIGHTDATA_WEB_UNLOCKER_ZONE (optional)

  • Zone name for Web Unlocker API
  • Default: web_unlocker1
  • WEB_UNLOCKER_ZONE is accepted as an alias if the prefixed name is unset

BRIGHTDATA_SERP_ZONE (optional)

  • Zone name for SERP (Search Engine Results Page) API
  • Default: serp_api1

BRIGHTDATA_BROWSER_AUTH (optional, secret)

  • Authentication credentials for Scraping Browser
  • Format: brd-customer-<customer-id>-zone-<zone-name>:<password>
  • Required only if using browser tools with authentication

Example

export BRIGHTDATA_API_TOKEN="your-api-token-here"
export BRIGHTDATA_BROWSER_AUTH="brd-customer-12345-zone-myzone:password123"

Tools

The plugin provides nine tools:

Tool Description
search_engine Search the web via Bright Data SERP API and return parsed results. Use for current events, fact-checking, finding pages, or any web search. Bypasses bot detection; more reliable than built-in web search.
scrape Fetch a single URL as clean markdown (or html) using Bright Data Web Unlocker. Handles JavaScript, CAPTCHAs, and bot detection. Use to read any webpage, article, doc, or site.
scrape_batch Scrape multiple URLs in one call (max 20). Returns per-URL content or error. Use when you have several pages to read at once.
web_data Get structured JSON data from a supported platform via Bright Data Web Scraper API (e.g. an Amazon product page, a LinkedIn profile). Returns clean structured fields, not raw HTML. May take up to a minute.
session_stats Report Bright Data tool call counts for this session.
browser_navigate Open a URL in a Bright Data Scraping Browser (real browser with a persistent session). Use for interactive flows requiring clicks/typing. Requires the [browser] extra and BRIGHTDATA_BROWSER_AUTH.
browser_snapshot Return an accessibility-tree snapshot of the current browser page, including element refs to use with browser_act.
browser_act Perform an action on the current browser page: click, type, scroll, or wait. Get element refs from browser_snapshot first.
browser_get Read the current browser page: html, text, or a base64 screenshot.

Activation

Enable the plugin in Hermes:

hermes plugins enable brightdata

Verify it's loaded:

hermes plugins list

You should see brightdata listed with version 0.1.0.

Pricing

Bright Data offers a free tier with up to 5,000 requests per month. For higher volume, refer to Bright Data's pricing page for details on Web Unlocker, SERP API, Web Scraper API, and Scraping Browser plans.


For more information on Bright Data services, visit https://brightdata.com.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hermes_brightdata-0.1.0.tar.gz (18.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hermes_brightdata-0.1.0-py3-none-any.whl (13.4 kB view details)

Uploaded Python 3

File details

Details for the file hermes_brightdata-0.1.0.tar.gz.

File metadata

  • Download URL: hermes_brightdata-0.1.0.tar.gz
  • Upload date:
  • Size: 18.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.5

File hashes

Hashes for hermes_brightdata-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ac05d6cc462558a8b41fa659f53b83131ddb2324cf0933ae934fd0c98e6a12cf
MD5 738ecf75932fa6f46ba9203f4eca4ed0
BLAKE2b-256 5b8f4f30634aa6fa9ab1d5c6d21729e272213418c6f531a22ef31b446a01c3dd

See more details on using hashes here.

File details

Details for the file hermes_brightdata-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for hermes_brightdata-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ee38367481f90f09e8ee8ecf3e3ed757fa1f0715f50dcc358557502e0a95e2ac
MD5 e04edf9c54f4893acead166b29a13a90
BLAKE2b-256 c77854bc542281c28a1573c4fa03082fc7a6fa3d6f6910c29d9caeaeeefb173a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page