A package for generating responses with an LLM and evaluating them on MMLU.
Project description
Import functions from your package
from your_package_name import load_data, eval_mmlu
Use the load_data function to load your dataset
file_path = 'mmlu.jsonl' # Replace with the path to your JSONL file df = load_data(file_path)
Evaluate your LLM using the eval_mmlu function
eval_mmlu(df)
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kheops-0.1.1.tar.gz
(2.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file kheops-0.1.1.tar.gz.
File metadata
- Download URL: kheops-0.1.1.tar.gz
- Upload date:
- Size: 2.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c3a1a597dc903d04f28ecf9c3b10c43064913f0771320a5a128c8ba5a0e42879
|
|
| MD5 |
b05c23a852b82c5aca454689ebe37f8c
|
|
| BLAKE2b-256 |
2a5c34879e397c5ac9850d58b5df2e72b862cf12cd5b43b1badcaf91144386c5
|
File details
Details for the file kheops-0.1.1-py3-none-any.whl.
File metadata
- Download URL: kheops-0.1.1-py3-none-any.whl
- Upload date:
- Size: 3.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eaaaf22cf6452fb528870132eea93e8419e24bbfa2d774b5988e6c4077f2e4f8
|
|
| MD5 |
f1815b8e731780578140c038f5cbef05
|
|
| BLAKE2b-256 |
f8563cd733c43400505d25972659c1bcfdbaa4caed9a9dafde51127afc0210b2
|
