A sitreamlined version of "LLM-Math" that judges the math solutions of LLMs.

Project description

LLM-MathJudger

基于 LLM-Math 简化的数学判别器. 该版本仅用于数学检查，因此不需要加载模型.

basic_check(A, B)

检查 A, B 两个纯数学表达式是否一致，返回 True / False.
check(prompt_type, data_name, target, pred)

检查 pred 是否与 target 一致，返回 True / False. target 即为数据集的某一行.

支持的 prompt 类型: tool-integrated, direct, cot, pal, self-instruct, self-instruct-boxed, tora, wizard_zs, platypus_fs, deepseek-math, kpmath.
支持的数据集: gsm8k, math, svamp, asdiv, mawps, tabmwp, mathqa, mmlu_stem, sat_math.

该版本为了提高速度采用了激进的修改，还未经严格测试，请谨慎使用.

This version

0.2.1

Oct 10, 2024

0.2.0

Oct 8, 2024

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Oct 10, 2024 Source

Uploaded Oct 10, 2024 Python 3

Details for the file llm_mathjudger-0.2.1.tar.gz.

Hashes for llm_mathjudger-0.2.1.tar.gz
Algorithm	Hash digest
SHA256	`a20bd84679bdd94a592a288b75524eb86ccdf7dca6904aa2aeb923f784e25798`
MD5	`77343fb0214eaf7c7d67e8d37c0bc1a8`
BLAKE2b-256	`382b44c3c9ce924106e7e0c935d8ef13601efe0581b16430963f5a16ad829eae`

Details for the file llm_mathjudger-0.2.1-py3-none-any.whl.

Hashes for llm_mathjudger-0.2.1-py3-none-any.whl
Algorithm	Hash digest
SHA256	`00c498ec8d0a51e4e17de326935edc1f2b5885247ec6d7de2ffd7b70792d64ec`
MD5	`794aa876c102f0e5164cdeaac2af2236`
BLAKE2b-256	`04c0d68a591c07cd708ff4bc3fbae6e43aa595e5b4cc123c79c72e7026a8eb84`