Skip to main content

Geonode Scraper CrewAI Tools

CrewAI tools for the Geonode Scraper API.

This package depends on geonode-scraper-tools-core for the shared service, schemas, and operation registry.

Installation

pip install geonode-scraper-crewai

Usage

from crewai import Agent

from geonode_scraper_crewai import build_crewai_tools
from geonode_scraper_tools_core import ScraperToolSettings

settings = ScraperToolSettings(
    host="https://api.example.com",
    api_key="your-api-key",
)

agent = Agent(
    role="Web Researcher",
    goal="Extract and inspect web content.",
    backstory="Focused on pulling structured data from URLs.",
    tools=build_crewai_tools(settings=settings),
)

Selecting a Subset of Tools

Pass an operations list to expose only the tools you need.

tools = build_crewai_tools(
    settings=settings,
    operations=["extract", "map_urls", "create_crawl", "wait_for_crawl"],
)

Exposed Tools

Extraction

  • scraper_extract_content
  • scraper_get_job_result
  • scraper_wait_for_job
  • scraper_list_jobs

Batch

  • scraper_create_batch
  • scraper_get_batch_status
  • scraper_wait_for_batch
  • scraper_list_batch_jobs

Crawl

  • scraper_create_crawl
  • scraper_get_crawl_status
  • scraper_wait_for_crawl
  • scraper_list_crawl_jobs

Map

  • scraper_map_urls
  • scraper_list_map_jobs
  • scraper_get_map_job

Search

  • scraper_search
  • scraper_list_search_jobs
  • scraper_get_search_job

Statistics, Usage & Health

  • scraper_get_statistics
  • scraper_get_concurrency_usage
  • scraper_check_health

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

geonode_scraper_crewai-0.4.0.tar.gz (3.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

geonode_scraper_crewai-0.4.0-py3-none-any.whl (3.3 kB view details)

Uploaded Python 3

File details

Details for the file geonode_scraper_crewai-0.4.0.tar.gz.

File metadata

  • Download URL: geonode_scraper_crewai-0.4.0.tar.gz
  • Upload date:
  • Size: 3.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for geonode_scraper_crewai-0.4.0.tar.gz
Algorithm Hash digest
SHA256 5c9168c4dcd3ed1cf515d2dfa42e2d07efd43f5e2b22dce5bf1e861e81a9ee47
MD5 3718407ae8c421e50fb5489bda13d2a9
BLAKE2b-256 be8f11497e71239e5f9a44044dc60c2fe1ce5b7dab484d8fd2098372428e6115

See more details on using hashes here.

Provenance

The following attestation bundles were made for geonode_scraper_crewai-0.4.0.tar.gz:

Publisher: python-crewai-tools-publish.yml on geonodecom/scraper-api-sdks

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file geonode_scraper_crewai-0.4.0-py3-none-any.whl.

File metadata

File hashes

Hashes for geonode_scraper_crewai-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8fafddbbb6fd3c2ff60ff1c6f40e35f82798d55e5128d466ac9fbe0fd26d14b2
MD5 3d0d12697f3d401d5801afaf57cf5327
BLAKE2b-256 d4183d18ac2d895cd4f54a0829a22d2ffa76fd331c77893f2f78b25f401da414

See more details on using hashes here.

Provenance

The following attestation bundles were made for geonode_scraper_crewai-0.4.0-py3-none-any.whl:

Publisher: python-crewai-tools-publish.yml on geonodecom/scraper-api-sdks

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.4.0 This release

2 files

0.3.0

2 files

0.2.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page