Skip to main content

render-lab-tasks-braintrust

Unreleased Python port: 12 registered tasks from render-lab/render-tasks. Python 3.12+, Render SDK 1.0.1. Requires core 0.1.1 or later.

From the repository root:

uv sync --all-packages --locked

Import render_lab_tasks_braintrust.tasks to register tasks. The package root is inert. Compose the exported app with Workflows.from_workflows; call tasks through ctx.run. Every operation also exports *_impl(ctx, input, *, deps=None) for injection. Client(http, env) accepts a caller-owned HTTPX client, and Deps(braintrust=client) injects it. Default dependencies open and close the HTTP client per invocation; credentials are read lazily at use. No HTTP retries or background vendor polling occur; retry.py owns the durable retry policies.

Task surface

Registered task Python export
braintrust.addFeedback add_feedback
braintrust.awaitReview await_review
braintrust.deleteDatasetRows delete_dataset_rows
braintrust.ensureDataset ensure_dataset
braintrust.ensureExperiment ensure_experiment
braintrust.gateExperiment gate_experiment
braintrust.getReviewProgress get_review_progress
braintrust.listDatasetRows list_dataset_rows
braintrust.logExperimentResults log_experiment_results
braintrust.runEval run_eval
braintrust.summarizeExperiment summarize_experiment
braintrust.upsertDatasetRows upsert_dataset_rows

Typed JSON inputs and results are in types.py. Task names and JSON field names match the pinned source; Python function names use snake_case.

Environment

Variable Requirement
BRAINTRUST_API_KEY Required at first API call.
BRAINTRUST_API_URL Optional; https://api.braintrust.dev by default.

Behavior and limits

Stable row IDs are required for upserts and experiment logs. Eval starts and release gates have no retries. Review polling counts rows carrying a score against root-row totals, matching the source; confirm review semantics with nested spans. Dataset pages and experiment summaries reject serialized results at or above 4 MiB. Gate errors contain the violated thresholds. Review polling and result counts remain unverified against a real project.

Verification

All registered tasks have hermetic contract fixtures executed independently against the pinned TS implementation. SDK-backed tasks also have explicit HTTP request fixtures. See tests/test_batch3_contracts.py and tests/test_batch3_edges.py. These are not live vendor results.

Vendor webhooks subpaths and other registration-free TS exports are outside this batch unless explicitly listed above. Full registered-task coverage does not imply all supporting exports are ported.

Pending scopes, test resources, replay, and hosted checks are in the live-testing backlog and verification tracker.

Installation

pip install render-lab-tasks-braintrust==0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

render_lab_tasks_braintrust-0.1.0.tar.gz (9.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

render_lab_tasks_braintrust-0.1.0-py3-none-any.whl (16.5 kB view details)

Uploaded Python 3

File details

Details for the file render_lab_tasks_braintrust-0.1.0.tar.gz.

File metadata

File hashes

Hashes for render_lab_tasks_braintrust-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ef3d57799b85d2d9a53d720566b918917c96e92839e8d14e2d069c04fbee55a2
MD5 83907bdb264349662cd8525e95ba5359
BLAKE2b-256 d0cc3316ffa9ab9450c696a77695a290b395f0bfc335e8f701adbc59009037be

See more details on using hashes here.

Provenance

The following attestation bundles were made for render_lab_tasks_braintrust-0.1.0.tar.gz:

Publisher: publish.yml on render-lab/render-tasks-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file render_lab_tasks_braintrust-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for render_lab_tasks_braintrust-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 200df2fe62dbf5fa75b0c6ba3c927da980822c9b56b9bb6e089a76707fd5af76
MD5 b1b463c41f642e77bbf33bb4307f471f
BLAKE2b-256 7057852338594c0c7ce4e891c42d6c63ca5a95dd99d0c24bd1739edc6712af06

See more details on using hashes here.

Provenance

The following attestation bundles were made for render_lab_tasks_braintrust-0.1.0-py3-none-any.whl:

Publisher: publish.yml on render-lab/render-tasks-python

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page