crewai-webmetadata-extractor
CrewAI tools for the Web Metadata, OpenGraph & Contact Extractor API — give a crew the ability to turn any URL into structured web intelligence, clean Markdown for RAG, contact signals for lead-gen, or a graded SEO audit.
pip install crewai-webmetadata-extractor
Quick start
Get a free API key on RapidAPI (1,000 requests/month, no credit card required).
from crewai import Agent
from crewai_webmetadata_extractor import get_tools
tools = get_tools(api_key="YOUR_RAPIDAPI_KEY")
# or leave api_key out and set the WEBMETADATA_API_KEY environment variable instead
researcher = Agent(
role="Web Researcher",
goal="Extract structured intelligence from URLs",
tools=tools,
...
)
Tools included
| Tool | Use it when the agent needs to... |
|---|---|
WebMetadataExtractTool |
Get a broad, all-in-one picture of a page (SEO, contacts, tech stack, security, links) |
WebMarkdownTool |
Ingest a page's actual content into a RAG pipeline as clean Markdown |
WebContactsTool |
Find public emails/phones/social links for outreach or lead-gen workflows |
WebSEOAuditTool |
Grade a page's SEO with a score, warnings, and readability metrics |
Every tool returns a JSON string — API errors come back as {"error": true, "status_code": ..., "detail": ...} instead of raising, so a crew can react to them without crashing.
Configuration
Pass api_key explicitly per tool, or set it once via the WEBMETADATA_API_KEY environment variable and omit it everywhere:
export WEBMETADATA_API_KEY=your-rapidapi-key
Links
- Python SDK this wraps (
webmetadata-extractor) - Also available for LangChain (
langchain-webmetadata-extractor) - Full API documentation
- Live interactive demo — no signup needed
License
MIT
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file crewai_webmetadata_extractor-0.1.0.tar.gz.
File metadata
- Download URL: crewai_webmetadata_extractor-0.1.0.tar.gz
- Upload date:
- Size: 4.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9683d6a39c7f55f0020484a22acf0107ff6150356aa79f3a7bc4d27c172b4c98
|
|
| MD5 |
aaccb7e337812b1e950f06a548bc61ec
|
|
| BLAKE2b-256 |
454e5961808518eff956a41c474993cfa24f5714a9cb1a3c1e5ee5c03c8c82c3
|
File details
Details for the file crewai_webmetadata_extractor-0.1.0-py3-none-any.whl.
File metadata
- Download URL: crewai_webmetadata_extractor-0.1.0-py3-none-any.whl
- Upload date:
- Size: 5.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/7.0.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0d54111b74038132e78d7ba0638f3ed9e695f518220fcf92a67aaf098fcc5917
|
|
| MD5 |
30ecc564a76ed273eb96661f05d090da
|
|
| BLAKE2b-256 |
461baf30590eedad2e3de2c3897ee3030d733cfc0e715325993a369c84f47d3a
|