A package to evaluate the models.
Project description
pycvtools
Functionality of the pyevaltool
- Automated testing of the bot response deployed gpt
pip install pyevaltool
To run
from pyevaltool import *
For GPT test -
url = '' # Add the frontend url
token = '' # add your token or key - Apim-Subscription-Key or Bearer token
# change the chat completion format if required.
# This code will work only if the question asked is at chat_completion_format['messages'][0]["content"]
chat_completion_format = {'chatId': '', 'siteInfo': {'domain': ''}, 'messages': [{'role': 'user', 'content': ''}], 'model': '', 'stream': False}
answer_loc = "['choices'][0]['messages'][0]['content']" #in string format
input_file = " " # Here you add your input file link
gpt_test(url,token,chat_completion_format,answer_loc,input_file,output_file = "output.csv" )
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyevaltool-0.1.7.tar.gz
(3.6 kB
view hashes)
Built Distribution
Close
Hashes for pyevaltool-0.1.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 832f51bcbad4c2bc9db19ffc3c81933bd033d77cf3aa5e92508ba5f73f809d86 |
|
MD5 | 8238f00bdf6c18e094b5d9f7d17f2cc2 |
|
BLAKE2b-256 | 301a37fa68756f530e762a87108e2dff9c2eac8f7d1db37130fef9769f518a7a |