Skip to main content

A package for generating responses with an LLM and evaluating them on MMLU.

Project description

Import functions from your package

from your_package_name import load_data, eval_mmlu

Use the load_data function to load your dataset

file_path = 'mmlu.jsonl' # Replace with the path to your JSONL file df = load_data(file_path)

Evaluate your LLM using the eval_mmlu function

eval_mmlu(df)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kheops-0.1.3.tar.gz (3.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kheops-0.1.3-py3-none-any.whl (3.3 kB view details)

Uploaded Python 3

File details

Details for the file kheops-0.1.3.tar.gz.

File metadata

  • Download URL: kheops-0.1.3.tar.gz
  • Upload date:
  • Size: 3.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.11

File hashes

Hashes for kheops-0.1.3.tar.gz
Algorithm Hash digest
SHA256 ec4fe3352468e6954379e044fd9d89d62d6fde4ac6cb25c1699716e4e2249690
MD5 3a7a64c3250e9565e9d96f73544b363f
BLAKE2b-256 5cdf459ce40f28a4d4beb735db93885d343e96e423d7c845a02f1c2e7cc304f2

See more details on using hashes here.

File details

Details for the file kheops-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: kheops-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 3.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.11

File hashes

Hashes for kheops-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 c8d48bd300e3de62b9f639373cd7ce00bacf44f45722a25bb74a86f0309d1a71
MD5 8a1feb406837b80f024c43620aa8eecf
BLAKE2b-256 d3e5a1c41b18cb3271c70a4da2da218961fb6da7b91fe1a7fcfe21bb6e7e3043

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page