Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

vibesys-evaluator

Build VibeSys benchmark evaluators for services: workloads, phases and validation.

pip install vibesys-evaluator

The Python package is a thin wrapper over a Go core. The wheels for Linux and macOS (x86_64 and arm64) bundle the Go binaries (vibesys-evaluator, loadgen and otelcapture), so one pip install is all a task needs: no Go toolchain, no go install. The Linux wheels are static and carry both the manylinux and the musllinux tags.

The package looks for each binary in the wheel first, then in an environment variable (VIBESYS_EVALUATOR_BIN, VIBESYS_EVALUATOR_LOADGEN, VIBESYS_EVALUATOR_OTELCAPTURE), then on PATH. A source distribution, or a platform without a wheel, has no bundled binary: build the binaries with Go and name them in those variables.

go install github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go/cmd/vibesys-evaluator@<tag>
go install github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go/cmd/loadgen@<tag>
export VIBESYS_EVALUATOR_BIN="$(command -v vibesys-evaluator)"

Go authors import the module github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go (tags sdk/vibesys-evaluator/go/v<semver>, cut with each release) and need no wheel.

The design and the public API are in the repository: sdk/vibesys-evaluator/docs/spec.md.

Metadata

Release files for vibesys-evaluator 0.3.0rc3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vibesys-evaluator 0.3.0rc3
File Size Uploaded Provenance Actions
vibesys_evaluator-0.3.0rc3.tar.gz 153.5 kB With provenance Details for vibesys_evaluator-0.3.0rc3.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for vibesys-evaluator 0.3.0rc3
File Actions
vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl Python 3 none Linux glibc 2.17+ x86-64, Linux musl 1.2+ x86-64 Details for vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl
vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl Python 3 none Linux musl 1.2+ ARM64, Linux glibc 2.17+ ARM64 Details for vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl
vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_x86_64.whl Python 3 none macOS 12.0+ x86-64 Details for vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_x86_64.whl
vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_arm64.whl Python 3 none macOS 12.0+ ARM64 Details for vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_arm64.whl

Total release size: 39.6 MB

Release files / vibesys_evaluator-0.3.0rc3.tar.gz

Download URL vibesys_evaluator-0.3.0rc3.tar.gz
Size 153.5 kB
Tags Source
SHA-256 checksum
How to use checksums
797688ffcebe62690e6989a8ca8f92de78d30eb0be7542cea3f091e5b121fd05
BLAKE2b-256 checksum
How to use checksums
068c869607232e721b16ae9315213aa2f44e2d6af28863f8a1bd828b81eb8ce7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl

Download URL vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl
Size 10.2 MB
Tags Linux glibc 2.17+ x86-64 Linux musl 1.2+ x86-64 Python 3
SHA-256 checksum
How to use checksums
5fa48c01f145d58a129f49b521d5ae39c116ec229bcb5e02f13181fd7775c7aa
BLAKE2b-256 checksum
How to use checksums
1bf728a0d4eb973b9f9efc5fda2febcfdcb68db20e369c711cd233f913d71fbc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl

Download URL vibesys_evaluator-0.3.0rc3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl
Size 9.2 MB
Tags Linux glibc 2.17+ ARM64 Linux musl 1.2+ ARM64 Python 3
SHA-256 checksum
How to use checksums
6594b04dc2184b54d47dabe654183d1de77972ec8ee45b06e59ec2579c41ee3e
BLAKE2b-256 checksum
How to use checksums
5f63bdd7a7e54df1dc145ff434fbf32e8d6523651ab883699850e25a804beb66
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_x86_64.whl

Download URL vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_x86_64.whl
Size 10.3 MB
Tags Python 3 macOS 12.0+ x86-64
SHA-256 checksum
How to use checksums
d538417468513a2150ab024ec898693bd307eedb457f3afe1c24200d69e623d6
BLAKE2b-256 checksum
How to use checksums
6fac8d3749c1736d04c8563dabaceb9ec586f87547db20c8d08e0f6e074ab34c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_arm64.whl

Download URL vibesys_evaluator-0.3.0rc3-py3-none-macosx_12_0_arm64.whl
Size 9.6 MB
Tags Python 3 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
89fe7bbeca625086c22c9708b4bf8efd47071847e3e39eddc214c13e5225c74f
BLAKE2b-256 checksum
How to use checksums
4b15e0e360b54770b3c7176a9b44648e6a366416e142571de1f0edc21ae0ac7a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Security for vibesys-evaluator 0.3.0rc3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 5 files in this release have been uploaded with provenance metadata.

Select from 5 files

Attestation for vibesys_evaluator-0.3.0rc3.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page