Geonode Scraper CrewAI Tools

CrewAI tools for the Geonode Scraper API.

This package depends on geonode-scraper-tools-core for the shared service, schemas, and operation registry.

Installation

pip install geonode-scraper-crewai

Usage

from crewai import Agent

from geonode_scraper_crewai import build_crewai_tools
from geonode_scraper_tools_core import ScraperToolSettings

settings = ScraperToolSettings(
    host="https://api.example.com",
    api_key="your-api-key",
)

agent = Agent(
    role="Web Researcher",
    goal="Extract and inspect web content.",
    backstory="Focused on pulling structured data from URLs.",
    tools=build_crewai_tools(settings=settings),
)

Selecting a Subset of Tools

Pass an operations list to expose only the tools you need.

tools = build_crewai_tools(
    settings=settings,
    operations=["extract", "map_urls", "create_crawl", "wait_for_crawl"],
)

Exposed Tools

Extraction

• scraper_extract_content
• scraper_get_job_result
• scraper_wait_for_job
• scraper_list_jobs

Batch

• scraper_create_batch
• scraper_get_batch_status
• scraper_wait_for_batch
• scraper_list_batch_jobs

Crawl

• scraper_create_crawl
• scraper_get_crawl_status
• scraper_wait_for_crawl
• scraper_list_crawl_jobs

Map

• scraper_map_urls
• scraper_list_map_jobs
• scraper_get_map_job

Search

• scraper_search
• scraper_list_search_jobs
• scraper_get_search_job

Statistics, Usage & Health

• scraper_get_statistics
• scraper_get_concurrency_usage
• scraper_check_health