Skip to main content

skilltest-sdk

The Python SDK for the skilltest CLI. A thin, typed wrapper and nothing else: it runs the CLI as a subprocess and parses the stable --format json contract into Pydantic models. Test-framework integrations build on it — use skilltest-pytest if you want pytest collection; use this package directly from any other Python code.

from skilltest_sdk import run_skill, validate_skill

report = run_skill("cases/greet.yaml")
assert report.passed, report.describe_failures()
# Mix in deterministic checks on the transcript:
assert "Dr. Smith" in report.runs[0].transcript.assistant_text()

result = validate_skill("skills/greeter")
assert result.valid

The skilltest binary is resolved from the bin= argument, the SKILLTEST_BIN env var, or PATH; a provider override comes from provider= or SKILLTEST_PROVIDER. A failing eval is reported (report.passed is false), not raised; bad input raises SkilltestUsageError (CLI exit 2) and provider problems raise SkilltestProviderError (exit 3).

The Pydantic models are generated from schemas/report.schema.json / schemas/validation.schema.json — themselves generated from the CLI's own types — via just gen-contract, and a drift gate in CI fails if anything is stale, so the models cannot diverge from the binary.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

skilltest_sdk-0.4.0.tar.gz (41.6 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

skilltest_sdk-0.4.0-py3-none-manylinux_2_17_x86_64.whl (984.6 kB view details)

Uploaded Python 3manylinux: glibc 2.17+ x86-64

skilltest_sdk-0.4.0-py3-none-manylinux_2_17_aarch64.whl (930.6 kB view details)

Uploaded Python 3manylinux: glibc 2.17+ ARM64

skilltest_sdk-0.4.0-py3-none-macosx_11_0_arm64.whl (882.0 kB view details)

Uploaded Python 3macOS 11.0+ ARM64

skilltest_sdk-0.4.0-py3-none-macosx_10_12_x86_64.whl (937.1 kB view details)

Uploaded Python 3macOS 10.12+ x86-64

skilltest_sdk-0.4.0-py3-none-any.whl (11.6 kB view details)

Uploaded Python 3

File details

Details for the file skilltest_sdk-0.4.0.tar.gz.

File metadata

  • Download URL: skilltest_sdk-0.4.0.tar.gz
  • Upload date:
  • Size: 41.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0.tar.gz
Algorithm Hash digest
SHA256 6f94687f5f7d55ec7356928988fcd40b2259e3dc186afbe4787d7ed907ac47fc
MD5 13914ed36b7de8aa9185f657cc068c7c
BLAKE2b-256 f698b5fbe6490fc29fb98007aea131fafedcf132e34dd141af843a1556257920

See more details on using hashes here.

File details

Details for the file skilltest_sdk-0.4.0-py3-none-manylinux_2_17_x86_64.whl.

File metadata

  • Download URL: skilltest_sdk-0.4.0-py3-none-manylinux_2_17_x86_64.whl
  • Upload date:
  • Size: 984.6 kB
  • Tags: Python 3, manylinux: glibc 2.17+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0-py3-none-manylinux_2_17_x86_64.whl
Algorithm Hash digest
SHA256 33e7d461295ba39698f84af9bbe1216ebb095c2039eb228dc39989d6ba28175c
MD5 7b42da7af955486c6c23346436e3015a
BLAKE2b-256 a7e626a0afece0f694016509b610b233436635bacaee0de72dc31a4ecab630a6

See more details on using hashes here.

File details

Details for the file skilltest_sdk-0.4.0-py3-none-manylinux_2_17_aarch64.whl.

File metadata

  • Download URL: skilltest_sdk-0.4.0-py3-none-manylinux_2_17_aarch64.whl
  • Upload date:
  • Size: 930.6 kB
  • Tags: Python 3, manylinux: glibc 2.17+ ARM64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0-py3-none-manylinux_2_17_aarch64.whl
Algorithm Hash digest
SHA256 124e2659fc7572c9448f5be00c45535ecfb058e626adafcad00c0bcfed344c9f
MD5 e66317ca68a54f36e947b294657c712d
BLAKE2b-256 5fd793c6d6bacd284b42dc36c223caad8b51e7b780fbe3e1096d6c393e92ca75

See more details on using hashes here.

File details

Details for the file skilltest_sdk-0.4.0-py3-none-macosx_11_0_arm64.whl.

File metadata

  • Download URL: skilltest_sdk-0.4.0-py3-none-macosx_11_0_arm64.whl
  • Upload date:
  • Size: 882.0 kB
  • Tags: Python 3, macOS 11.0+ ARM64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0-py3-none-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 3502a3cce2f7b605d03edbdb5078b20c994d48960e5ba9ec3ed5ba738d0f4fa8
MD5 827f0a5059de1acecc7efb979bde8e7e
BLAKE2b-256 a8c88773621e7daaddbd9e22224f43c992e2a4010c52bb6b425705a0807c7b9d

See more details on using hashes here.

File details

Details for the file skilltest_sdk-0.4.0-py3-none-macosx_10_12_x86_64.whl.

File metadata

  • Download URL: skilltest_sdk-0.4.0-py3-none-macosx_10_12_x86_64.whl
  • Upload date:
  • Size: 937.1 kB
  • Tags: Python 3, macOS 10.12+ x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0-py3-none-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 5938cf141a287d4a516a733b193c9d1dca0ba6947cfe38149ed639e41664ec29
MD5 348683f541b0318860533b5ccfd0b318
BLAKE2b-256 5e25bd597acb3161c4009e1c34862ac3eed0d2940910fa43b7f5ed69aa81f278

See more details on using hashes here.

File details

Details for the file skilltest_sdk-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: skilltest_sdk-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 11.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.26 {"installer":{"name":"uv","version":"0.11.26","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for skilltest_sdk-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 918da0b80f61b49070b5e011e8998ea7de96ea0f9e70d309675f035878b9a57a
MD5 08cb0b2775f114e0635aad909c7e415c
BLAKE2b-256 a74e3cc6cb01b64342d110fb9c3e6178cb9e38d9c8c3606180244ae455d9a0fa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page