A package for generating responses with an LLM and evaluating them on MMLU.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for berrachedmedyazid from gravatar.com berrachedmedyazid

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT License
  • Author: KHEOPS TEAM
  • Requires: Python >=3.7
Classifiers
Report project as malware

Project description

Import functions from your package

from your_package_name import load_data, eval_mmlu

Use the load_data function to load your dataset

file_path = 'mmlu.jsonl' # Replace with the path to your JSONL file df = load_data(file_path)

Evaluate your LLM using the eval_mmlu function

eval_mmlu(df)

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for berrachedmedyazid from gravatar.com berrachedmedyazid

Unverified details

These details have not been verified by PyPI
Meta
  • License: MIT License
  • Author: KHEOPS TEAM
  • Requires: Python >=3.7
Classifiers

Release history Release notifications | RSS feed

This version

0.1.4

0.1.3

0.1.2

0.1.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kheops-0.1.4.tar.gz (2.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

kheops-0.1.4-py3-none-any.whl (2.1 MB view details)

Uploaded Python 3

File details

Details for the file kheops-0.1.4.tar.gz.

File metadata

  • Download URL: kheops-0.1.4.tar.gz
  • Upload date:
  • Size: 2.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.11

File hashes

Hashes for kheops-0.1.4.tar.gz
Algorithm Hash digest
SHA256 ef41a209a5150e47d6c19c1d801d59d1c2ee8b27fe152f1ea333a8f46ca2a8c3
MD5 0b4175b4f977113602cadfab293dd16d
BLAKE2b-256 ee334f0741b922abd74d3d5ff33e7ffb7cdc2c4b02f12c5d9dd2bc527becb6f4

See more details on using hashes here.

File details

Details for the file kheops-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: kheops-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 2.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.11

File hashes

Hashes for kheops-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 15886f4009c5c839bb852c3fbcc103858a1bc89a2bee51b46652693a182faecb
MD5 0988741616231cb53c72a28d0d95bb48
BLAKE2b-256 ff6ba2d2c0aeba71e374276f58b41598c2658a90b08f3e35f19bc619cfc45bc1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page