Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

vibesys-evaluator

Build VibeSys benchmark evaluators for services: workloads, phases and validation.

pip install vibesys-evaluator

The Python package is a thin wrapper over a Go core. The wheels for Linux and macOS (x86_64 and arm64) bundle the Go binaries (vibesys-evaluator, loadgen and otelcapture), so one pip install is all a task needs: no Go toolchain, no go install. The Linux wheels are static and carry both the manylinux and the musllinux tags.

The package looks for each binary in the wheel first, then in an environment variable (VIBESYS_EVALUATOR_BIN, VIBESYS_EVALUATOR_LOADGEN, VIBESYS_EVALUATOR_OTELCAPTURE), then on PATH. A source distribution, or a platform without a wheel, has no bundled binary: build the binaries with Go and name them in those variables.

go install github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go/cmd/vibesys-evaluator@<tag>
go install github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go/cmd/loadgen@<tag>
export VIBESYS_EVALUATOR_BIN="$(command -v vibesys-evaluator)"

Go authors import the module github.com/uw-syfi/vibesys/sdk/vibesys-evaluator/go (tags sdk/vibesys-evaluator/go/v<semver>, cut with each release) and need no wheel.

The design and the public API are in the repository: sdk/vibesys-evaluator/docs/spec.md.

Metadata

Release files for vibesys-evaluator 0.3.0rc2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for vibesys-evaluator 0.3.0rc2
File Size Uploaded Provenance Actions
vibesys_evaluator-0.3.0rc2.tar.gz 147.2 kB With provenance Details for vibesys_evaluator-0.3.0rc2.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for vibesys-evaluator 0.3.0rc2
File Actions
vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl Python 3 none Linux glibc 2.17+ x86-64, Linux musl 1.2+ x86-64 Details for vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl
vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl Python 3 none Linux glibc 2.17+ ARM64, Linux musl 1.2+ ARM64 Details for vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl
vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_x86_64.whl Python 3 none macOS 12.0+ x86-64 Details for vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_x86_64.whl
vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_arm64.whl Python 3 none macOS 12.0+ ARM64 Details for vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_arm64.whl

Total release size: 34.3 MB

Release files / vibesys_evaluator-0.3.0rc2.tar.gz

Download URL vibesys_evaluator-0.3.0rc2.tar.gz
Size 147.2 kB
Tags Source
SHA-256 checksum
How to use checksums
bb49cd8117e8dc93b318dc8d0fd8c1180e9a1e69fe0e541a79a2f2a110606b3d
BLAKE2b-256 checksum
How to use checksums
d49f0b2c445232fc6c2ff64a4d3fd5606bfa5081f7d9efc5a85b2960c4b3a9d2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl

Download URL vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.musllinux_1_2_x86_64.whl
Size 8.9 MB
Tags Linux glibc 2.17+ x86-64 Linux musl 1.2+ x86-64 Python 3
SHA-256 checksum
How to use checksums
a0d3c0cf663366d4af4c1ff60e52409baab008e17530c94ae88314c0854d5597
BLAKE2b-256 checksum
How to use checksums
0c34bd542323c82bb18b2fb6e3a1b2ec8c4dfa6017c9ce5c4e49b374e993519f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl

Download URL vibesys_evaluator-0.3.0rc2-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.musllinux_1_2_aarch64.whl
Size 8.0 MB
Tags Linux glibc 2.17+ ARM64 Linux musl 1.2+ ARM64 Python 3
SHA-256 checksum
How to use checksums
3ff826728ac81c5832e223ee9a4d442d20330b7e4932fda73ee0196897fefecb
BLAKE2b-256 checksum
How to use checksums
16b686e934d529fb0c1031bb58c409c2f328f234ce9ae26e953eb32999b5effd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_x86_64.whl

Download URL vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_x86_64.whl
Size 9.0 MB
Tags Python 3 macOS 12.0+ x86-64
SHA-256 checksum
How to use checksums
bd9c092c63afe9f82e35b92e8a008b68b7ed096f80ae98ad9563fb2c1e6647ff
BLAKE2b-256 checksum
How to use checksums
93cc962fd814a8978550e6550e2bf7aa5eafb19fbc5fdd6c5befc580350c9b5e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Release files / vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_arm64.whl

Download URL vibesys_evaluator-0.3.0rc2-py3-none-macosx_12_0_arm64.whl
Size 8.3 MB
Tags Python 3 macOS 12.0+ ARM64
SHA-256 checksum
How to use checksums
df26ffc87ffe229626ab668d7a695cacca7be177a086b6aee28724d785bbf9b0
BLAKE2b-256 checksum
How to use checksums
4516cadfe58caa38cf1f4e6a164e80f74460beec8f82bbf76f26f85136612efe
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

Security for vibesys-evaluator 0.3.0rc2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 5 files in this release have been uploaded with provenance metadata.

Select from 5 files

Attestation for vibesys_evaluator-0.3.0rc2.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 6, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page