Skip to main content

render-lab-tasks-firecrawl

Unreleased Python port: 12 registered tasks from render-lab/render-tasks. Python 3.12+, Render SDK 1.0.1. Requires core 0.1.1 or later.

From the repository root:

uv sync --all-packages --locked

Import render_lab_tasks_firecrawl.tasks to register tasks. The package root is inert. Compose the exported app with Workflows.from_workflows; call tasks through ctx.run. Every operation also exports *_impl(ctx, input, *, deps=None) for injection. Client(http, env) accepts a caller-owned HTTPX client, and Deps(firecrawl=client) injects it. Default dependencies open and close the HTTP client per invocation; credentials are read lazily at use. No HTTP retries or background vendor polling occur; retry.py owns the durable retry policies.

Task surface

Registered task Python export
firecrawl.awaitBatchScrape await_batch_scrape
firecrawl.awaitCrawl await_crawl
firecrawl.awaitExtract await_extract
firecrawl.cancelBatchScrape cancel_batch_scrape
firecrawl.cancelCrawl cancel_crawl
firecrawl.getJobResults get_job_results
firecrawl.map map
firecrawl.scrape scrape
firecrawl.search search
firecrawl.startBatchScrape start_batch_scrape
firecrawl.startCrawl start_crawl
firecrawl.startExtract start_extract

Typed JSON inputs and results are in types.py. Task names and JSON field names match the pinned source; Python function names use snake_case.

Environment

Variable Requirement
FIRECRAWL_API_KEY Required at first API call.

Behavior and limits

Uses Firecrawl v2. Each await makes one status check per durable attempt. Crawl and batch cancellation normalize 404. Returned content budgets use JavaScript UTF-16 character counts. Cursor requests are restricted to HTTPS api.firecrawl.dev before attaching credentials (ADR-0010). The inherited getJobResults maxResults slice can discard excess documents in a vendor page; use a page-sized maximum until cursor preservation is verified. Unknown extract statuses currently follow the source completion mapping; vendor status changes need live verification.

Verification

All registered tasks have hermetic contract fixtures executed independently against the pinned TS implementation. SDK-backed tasks also have explicit HTTP request fixtures. See tests/test_batch3_contracts.py and tests/test_batch3_edges.py. These are not live vendor results.

Vendor webhooks subpaths and other registration-free TS exports are outside this batch unless explicitly listed above. Full registered-task coverage does not imply all supporting exports are ported.

Pending scopes, test resources, replay, and hosted checks are in the live-testing backlog and verification tracker.

Webhook adapter

render_lab_tasks_firecrawl.webhooks.firecrawl_adapter(on_event, ...) returns a registration-free adapter for render_lab_triggers. The callback receives the verified event and returns {"task": "namespace.task", "args": [event]} or None. The signing credential FIRECRAWL_WEBHOOK_SECRET is read inside verification unless provided explicitly. Importing this module does not register tasks. Signature checks use the raw body; live delivery remains in the testing backlog.

Installation

pip install render-lab-tasks-firecrawl==0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

render_lab_tasks_firecrawl-0.1.0.tar.gz (9.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

render_lab_tasks_firecrawl-0.1.0-py3-none-any.whl (16.6 kB view details)

Uploaded Python 3

File details

Details for the file render_lab_tasks_firecrawl-0.1.0.tar.gz.

File metadata

File hashes

Hashes for render_lab_tasks_firecrawl-0.1.0.tar.gz
Algorithm Hash digest
SHA256 de432f0e7671d1cd1357bbee966c78a3c0ed7bcf83fcbf3a964aa25246ba186e
MD5 971d3b8c5d275d751ece35227c142139
BLAKE2b-256 6e448233343c1342b2e4064604fa4678c88b997a26f691dd572dd5c08244454e

See more details on using hashes here.

Provenance

The following attestation bundles were made for render_lab_tasks_firecrawl-0.1.0.tar.gz:

Publisher: publish.yml on render-lab/render-tasks-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file render_lab_tasks_firecrawl-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for render_lab_tasks_firecrawl-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 bfeb09fb1c09f59870be65ac76494dab4e55860c814cfccc24165a797eaebb2c
MD5 04824e2c004bf3d4a2e273d04ccb6c3a
BLAKE2b-256 e2d78682ae25374382b4f7592a1a94791d0021b960ccc60790b42a8355c08960

See more details on using hashes here.

Provenance

The following attestation bundles were made for render_lab_tasks_firecrawl-0.1.0-py3-none-any.whl:

Publisher: publish.yml on render-lab/render-tasks-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page