render-lab-tasks-scrape
Python port of all 7 registered tasks in the pinned TypeScript pack at
45f9c2d44bd28e01ae9813e0d2ff56ee6c533816. Python 3.12+.
Install this distribution and its dependencies:
pip install render-lab-tasks-scrape==0.1.0
Import definitions from render_lab_tasks_scrape.tasks; combine app objects
with Workflows.from_workflows(...). JSON fields retain TS spelling; functions
use snake_case. Package root imports are inert.
Tasks
| Registered name | Python export (also exposes _impl) |
|---|---|
scrape.crawl |
crawl |
scrape.extract |
extract |
scrape.extractLinks |
extract_links |
scrape.extractMetadata |
extract_metadata |
scrape.sitemap |
sitemap |
scrape.toMarkdown |
to_markdown |
scrape.fetch |
fetch |
Dependencies and retries
Raw implementations accept context first and keyword-only deps. The .client
module exports typed Port, Deps, and Client classes. Inject a fake port, or
pass a caller-owned httpx.AsyncClient to Client. Default dependencies close
their client after one operation. Credentials resolve at first use. Transport
retries are disabled; retry.py owns durable policies. DTO types are in .types.
Requires core >=0.1.1.
Environment
No environment variables. Caller-provided headers carry authentication.
Verification and limitations
The extractor is a minimal regex parser. It does not execute JavaScript, honor robots.txt, or provide DOM selectors. It follows redirects; 429/5xx raise and other 4xx return a result. Crawl uses a breadth-first queue, defaults to ten successful pages on the same host, and does not cap the number of failed-page requests. Use trusted URLs and caller-chosen bounds. No Firecrawl/Browserbase adapter is included.
Shared fixtures execute the actual pinned TS implementations and compare Python outputs and requests. Sanity's SDK calls are translated into separately asserted REST requests. These are hermetic checks, not real account or hosted verification. See the testing backlog and the root verification tracker. Licensed under MIT.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file render_lab_tasks_scrape-0.1.0.tar.gz.
File metadata
- Download URL: render_lab_tasks_scrape-0.1.0.tar.gz
- Upload date:
- Size: 6.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2b01a02ee0c73c89a0587153bef9dc3a29b8010cb44805b4686ad4f52a495f34
|
|
| MD5 |
656db47b524b8180af451993061a9105
|
|
| BLAKE2b-256 |
d7cc184226cf796a1a397455e637f05da65cb36551e3f4c3bab661376f00e10a
|
Provenance
The following attestation bundles were made for render_lab_tasks_scrape-0.1.0.tar.gz:
Publisher:
publish.yml on render-lab/render-tasks-python
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
render_lab_tasks_scrape-0.1.0.tar.gz -
Subject digest:
2b01a02ee0c73c89a0587153bef9dc3a29b8010cb44805b4686ad4f52a495f34 - Sigstore transparency entry: 2767968625
- Sigstore integration time:
-
Permalink:
render-lab/render-tasks-python@b601664587ba5882dd7c8efabfc8908151008df6 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/render-lab
-
Access:
internal
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@b601664587ba5882dd7c8efabfc8908151008df6 -
Trigger Event:
workflow_dispatch
-
Statement type:
File details
Details for the file render_lab_tasks_scrape-0.1.0-py3-none-any.whl.
File metadata
- Download URL: render_lab_tasks_scrape-0.1.0-py3-none-any.whl
- Upload date:
- Size: 11.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4c022dc51bdd0c2583480e28a113e5effc592867ee73ef7e048b72e863dd6d8f
|
|
| MD5 |
02f863ec4fa83e86f78ce4aab09b0a2b
|
|
| BLAKE2b-256 |
ccbd3854ad1f404f60cabd419c974c53f637bdef7c5b18d9c27f8ebc3ee1f00c
|
Provenance
The following attestation bundles were made for render_lab_tasks_scrape-0.1.0-py3-none-any.whl:
Publisher:
publish.yml on render-lab/render-tasks-python
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
render_lab_tasks_scrape-0.1.0-py3-none-any.whl -
Subject digest:
4c022dc51bdd0c2583480e28a113e5effc592867ee73ef7e048b72e863dd6d8f - Sigstore transparency entry: 2767968729
- Sigstore integration time:
-
Permalink:
render-lab/render-tasks-python@b601664587ba5882dd7c8efabfc8908151008df6 -
Branch / Tag:
refs/heads/main - Owner: https://github.com/render-lab
-
Access:
internal
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@b601664587ba5882dd7c8efabfc8908151008df6 -
Trigger Event:
workflow_dispatch
-
Statement type:
