Skip to main content

Craft and run benchmarks.

Project description

Eval Editor

Eval Editor Screenshot

Features

  • Web-Based UI: Easy-to-use interface that runs in your browser.
  • Create, Load, and Edit: Full CRUD (Create, Read, Update, Delete) functionality for evaluation files.
  • Structured JSON Output: Saves evaluations in a clean, human-readable .json format.
  • Rich Metadata: Define essential metadata for each evaluation, including a name, author, revision, and description.
  • Shared System Prompt: Set a single system prompt that applies to all questions within an evaluation set for consistency.
  • Dynamic Question/Answer Pairs: Easily add or remove multiple user questions and their corresponding ideal answers.

Tech Stack

  • Backend: Python with Flask
  • Frontend: HTML, Tailwind CSS, and Vanilla JavaScript (ES6+)

Quick Start

pip install Flask
python main.py

Open your browser and navigate to http://localhost:5000

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

benchcraft-0.0.1-py3-none-any.whl (17.0 kB view details)

Uploaded Python 3

File details

Details for the file benchcraft-0.0.1-py3-none-any.whl.

File metadata

  • Download URL: benchcraft-0.0.1-py3-none-any.whl
  • Upload date:
  • Size: 17.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for benchcraft-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 da5c7f98d9ebf0e3b42951394caed816a0ed76c97a801f20cd1c17ccc6f859b0
MD5 bb6b37338e8f4d6daf128bcde354eabc
BLAKE2b-256 cde41cfaaf99a719c7c749306a0ccfca391b5883df33afd0d7c0b02d86277014

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page