crewai-webmetadata-extractor
CrewAI tools for the Web Metadata, OpenGraph & Contact Extractor API — give a crew the ability to turn any URL into structured web intelligence, clean Markdown for RAG, contact signals for lead-gen, or a graded SEO audit.
pip install crewai-webmetadata-extractor
Quick start
Get a free API key on RapidAPI (1,000 requests/month, no credit card required).
from crewai import Agent
from crewai_webmetadata_extractor import get_tools
tools = get_tools(api_key="YOUR_RAPIDAPI_KEY")
# or leave api_key out and set the WEBMETADATA_API_KEY environment variable instead
researcher = Agent(
role="Web Researcher",
goal="Extract structured intelligence from URLs",
tools=tools,
...
)
Tools included
| Tool | Use it when the agent needs to... |
|---|---|
WebMetadataExtractTool |
Get a broad, all-in-one picture of a page (SEO, contacts, tech stack, security, links) |
WebMarkdownTool |
Ingest a page's actual content into a RAG pipeline as clean Markdown |
WebContactsTool |
Find public emails/phones/social links for outreach or lead-gen workflows |
WebSEOAuditTool |
Grade a page's SEO with a score, warnings, and readability metrics |
Every tool returns a JSON string — API errors come back as {"error": true, "status_code": ..., "detail": ...} instead of raising, so a crew can react to them without crashing.
Configuration
Pass api_key explicitly per tool, or set it once via the WEBMETADATA_API_KEY environment variable and omit it everywhere:
export WEBMETADATA_API_KEY=your-rapidapi-key
Links
- Python SDK this wraps (
webmetadata-extractor) - Also available for LangChain (
langchain-webmetadata-extractor) - Full API documentation
- Live interactive demo — no signup needed
License
MIT
Metadata
Release files for crewai-webmetadata-extractor 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| crewai_webmetadata_extractor-0.1.0.tar.gz | 4.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| crewai_webmetadata_extractor-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 10.3 kB
Release files / crewai_webmetadata_extractor-0.1.0.tar.gz
| Download URL | crewai_webmetadata_extractor-0.1.0.tar.gz |
|---|---|
| Size | 4.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9683d6a39c7f55f0020484a22acf0107ff6150356aa79f3a7bc4d27c172b4c98
|
|
BLAKE2b-256 checksum How to use checksums |
454e5961808518eff956a41c474993cfa24f5714a9cb1a3c1e5ee5c03c8c82c3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.9
|
Release files / crewai_webmetadata_extractor-0.1.0-py3-none-any.whl
| Download URL | crewai_webmetadata_extractor-0.1.0-py3-none-any.whl |
|---|---|
| Size | 5.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
0d54111b74038132e78d7ba0638f3ed9e695f518220fcf92a67aaf098fcc5917
|
|
BLAKE2b-256 checksum How to use checksums |
461baf30590eedad2e3de2c3897ee3030d733cfc0e715325993a369c84f47d3a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.11.9
|