Thabit
Evaluate multiple LLM models with the same data to determine which one is better for your use case.
How to run
pip3 install thabit
Test
pytest tests
Build
pip3 install -e .
Contribute
Docs
TODO:
-
Validate the input dataset.
-
UI for adding/editing config.
-
Visulaise Output (using UI).
-
Run eval per dataset (add folders for dataset and for evals). This is to simplify visualising results later using the UI.
root ├── datasets │ └── a └── evals └── a
1 maintainer
Metadata
1 maintainer
Release files for thabit 0.2.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| thabit-0.2.5.tar.gz | 60.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| thabit-0.2.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 123.8 kB
Release files / thabit-0.2.5.tar.gz
| Download URL | thabit-0.2.5.tar.gz |
|---|---|
| Size | 60.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3b4f82e78e86aa0e09a5b75641b61edabc8d7a657a6179eaa7c7ce15aef96806
|
|
BLAKE2b-256 checksum How to use checksums |
b09cf0c6beed3969797a881e99ddfffe4a9e647e4ffe6fda20935c3af25fc349
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.8.19
|
Release files / thabit-0.2.5-py3-none-any.whl
| Download URL | thabit-0.2.5-py3-none-any.whl |
|---|---|
| Size | 63.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
81c702f327d1a23dbe0dada3bf64d5c2b3d8f3d1331c96af02deacf45c7a6e77
|
|
BLAKE2b-256 checksum How to use checksums |
29b6ba56b885e2939257d21bf3092e197af25bed66cdfff9a0b5183c1f403602
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.8.19
|
