Skip to main content

kedro-softfail-runner

This file will become your README and also the index of your documentation.

Install

pip install kedro_softfail_runner

How to use

Fill me in please! Don’t forget code examples:

kedro run --runner=kedro_softfail_runner.SoftFailRunner

Why is it useful?

The team created a soft-fail runner to transform errors into warnings, allowing the pipeline to continue executing to the best of its ability while providing a report of any nodes that failed, so that data issues can be addressed. At that point, the pipeline run can be finalised by executing only those missing nodes separately, using appropriate Kedro syntax. https://kedro.org/blog/build-a-custom-kedro-runner

It’s most useful in two different scenarios: 1. Development - you want to detect all problematic nodes in one go 2. Deployment - you want to run as much node as you can before the Kedro pipeline is stopped.

Why is it not in Kedro yet?

Note that the SoftFailRunner does not return anything, that is result = session.run() normally returns a dictionary of free output, but it will be always None for SoftFailRunner due to implementation problem.

Other than that, there are no other known issues yet. In order to merge this into the core library, this problem need to be fixed and the runner should be test thoroughly.

Metadata

Release files for kedro-softfail-runner 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for kedro-softfail-runner 0.0.3
File Size Uploaded Provenance Actions
kedro-softfail-runner-0.0.3.tar.gz 9.9 kB Without provenance Details for kedro-softfail-runner-0.0.3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for kedro-softfail-runner 0.0.3
File Interpreter ABI Platform Actions
kedro_softfail_runner-0.0.3-py3-none-any.whl Python 3 none any Details for kedro_softfail_runner-0.0.3-py3-none-any.whl

Total release size: 19.7 kB

Release files / kedro-softfail-runner-0.0.3.tar.gz

Download URL kedro-softfail-runner-0.0.3.tar.gz
Size 9.9 kB
Tags Source
SHA-256 checksum
How to use checksums
b339a58b83e34c894ffff8df7e716e8e48ceacf733461db9af1904329b7abcc9
BLAKE2b-256 checksum
How to use checksums
bb2603a21bec18821d254cc625814df3aac694b075b2e670dc48cae85d06e4e4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.8.5

Release files / kedro_softfail_runner-0.0.3-py3-none-any.whl

Download URL kedro_softfail_runner-0.0.3-py3-none-any.whl
Size 9.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3a8cc99d15089ccf43c25d915d841d1e5748785c4663e9e7912185cf74f1c147
BLAKE2b-256 checksum
How to use checksums
ab9ab82f6fefd2699fcb617f8976170b1da6896583f900e0102e0a8e0dc55bbe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.8.5

Security for kedro-softfail-runner 0.0.3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page