Skip to main content

crewai-webmetadata-extractor

CrewAI tools for the Web Metadata, OpenGraph & Contact Extractor API — give a crew the ability to turn any URL into structured web intelligence, clean Markdown for RAG, contact signals for lead-gen, or a graded SEO audit.

pip install crewai-webmetadata-extractor

Quick start

Get a free API key on RapidAPI (1,000 requests/month, no credit card required).

from crewai import Agent
from crewai_webmetadata_extractor import get_tools

tools = get_tools(api_key="YOUR_RAPIDAPI_KEY")
# or leave api_key out and set the WEBMETADATA_API_KEY environment variable instead

researcher = Agent(
    role="Web Researcher",
    goal="Extract structured intelligence from URLs",
    tools=tools,
    ...
)

Tools included

Tool Use it when the agent needs to...
WebMetadataExtractTool Get a broad, all-in-one picture of a page (SEO, contacts, tech stack, security, links)
WebMarkdownTool Ingest a page's actual content into a RAG pipeline as clean Markdown
WebContactsTool Find public emails/phones/social links for outreach or lead-gen workflows
WebSEOAuditTool Grade a page's SEO with a score, warnings, and readability metrics

Every tool returns a JSON string — API errors come back as {"error": true, "status_code": ..., "detail": ...} instead of raising, so a crew can react to them without crashing.

Configuration

Pass api_key explicitly per tool, or set it once via the WEBMETADATA_API_KEY environment variable and omit it everywhere:

export WEBMETADATA_API_KEY=your-rapidapi-key

License

MIT

Metadata

Release files for crewai-webmetadata-extractor 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for crewai-webmetadata-extractor 0.1.0
File Size Uploaded
crewai_webmetadata_extractor-0.1.0.tar.gz 4.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for crewai-webmetadata-extractor 0.1.0
File Interpreter ABI Platform
crewai_webmetadata_extractor-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 10.3 kB

Release files / crewai_webmetadata_extractor-0.1.0.tar.gz

Download URL crewai_webmetadata_extractor-0.1.0.tar.gz
Size 4.9 kB
Tags Source
SHA-256 checksum
How to use checksums
9683d6a39c7f55f0020484a22acf0107ff6150356aa79f3a7bc4d27c172b4c98
BLAKE2b-256 checksum
How to use checksums
454e5961808518eff956a41c474993cfa24f5714a9cb1a3c1e5ee5c03c8c82c3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.9

Release files / crewai_webmetadata_extractor-0.1.0-py3-none-any.whl

Download URL crewai_webmetadata_extractor-0.1.0-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0d54111b74038132e78d7ba0638f3ed9e695f518220fcf92a67aaf098fcc5917
BLAKE2b-256 checksum
How to use checksums
461baf30590eedad2e3de2c3897ee3030d733cfc0e715325993a369c84f47d3a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.11.9

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page