Skip to main content

crewai-webmetadata-extractor

CrewAI tools for the Web Metadata, OpenGraph & Contact Extractor API — give a crew the ability to turn any URL into structured web intelligence, clean Markdown for RAG, contact signals for lead-gen, or a graded SEO audit.

pip install crewai-webmetadata-extractor

Quick start

Get a free API key on RapidAPI (1,000 requests/month, no credit card required).

from crewai import Agent
from crewai_webmetadata_extractor import get_tools

tools = get_tools(api_key="YOUR_RAPIDAPI_KEY")
# or leave api_key out and set the WEBMETADATA_API_KEY environment variable instead

researcher = Agent(
    role="Web Researcher",
    goal="Extract structured intelligence from URLs",
    tools=tools,
    ...
)

Tools included

Tool Use it when the agent needs to...
WebMetadataExtractTool Get a broad, all-in-one picture of a page (SEO, contacts, tech stack, security, links)
WebMarkdownTool Ingest a page's actual content into a RAG pipeline as clean Markdown
WebContactsTool Find public emails/phones/social links for outreach or lead-gen workflows
WebSEOAuditTool Grade a page's SEO with a score, warnings, and readability metrics

Every tool returns a JSON string — API errors come back as {"error": true, "status_code": ..., "detail": ...} instead of raising, so a crew can react to them without crashing.

Configuration

Pass api_key explicitly per tool, or set it once via the WEBMETADATA_API_KEY environment variable and omit it everywhere:

export WEBMETADATA_API_KEY=your-rapidapi-key

Links

License

MIT

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crewai_webmetadata_extractor-0.1.0.tar.gz (4.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crewai_webmetadata_extractor-0.1.0-py3-none-any.whl (5.4 kB view details)

Uploaded Python 3

File details

Details for the file crewai_webmetadata_extractor-0.1.0.tar.gz.

File metadata

File hashes

Hashes for crewai_webmetadata_extractor-0.1.0.tar.gz
Algorithm Hash digest
SHA256 9683d6a39c7f55f0020484a22acf0107ff6150356aa79f3a7bc4d27c172b4c98
MD5 aaccb7e337812b1e950f06a548bc61ec
BLAKE2b-256 454e5961808518eff956a41c474993cfa24f5714a9cb1a3c1e5ee5c03c8c82c3

See more details on using hashes here.

File details

Details for the file crewai_webmetadata_extractor-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for crewai_webmetadata_extractor-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0d54111b74038132e78d7ba0638f3ed9e695f518220fcf92a67aaf098fcc5917
MD5 30ecc564a76ed273eb96661f05d090da
BLAKE2b-256 461baf30590eedad2e3de2c3897ee3030d733cfc0e715325993a369c84f47d3a

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page