medplexity helps with evaluation of LLMs for medical use-cases.
Project description
Medplexity
Medplexity is a python library to help with evaluation of LLMs for medical applications. It is designed to help with the following tasks
- Evaluating performance of LLMs on existing medical datasets and benchmarks. E.g. MedQA, PubMedQA, etc.
- Compare performance of different prompts, models, and architectures.
For example, we can help answer questions like "How much better would GPT-4 perform if it also would load relevant paragraphs from research?".
🔧 Quick install
pip install medplexity
Example
See /noteboks/MedMCQA.ipynb for a full example with MedMCQA dataset.
📜 License
Medplexity is licensed under the MIT License. See the LICENSE file for more details.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file medplexity-0.1.0.tar.gz.
File metadata
- Download URL: medplexity-0.1.0.tar.gz
- Upload date:
- Size: 20.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.10 Darwin/22.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f55e9b51fbec8fa15eac5c99103f900ff46f844eb0eb2634cc7b3a07c94fd286
|
|
| MD5 |
241646f39285cf8743692a49c73a7c06
|
|
| BLAKE2b-256 |
ce232f478a2f3e23c3907d3ed3ccbc7824f1c6c89b63a15e1fb0aa47a3bc2ca8
|
File details
Details for the file medplexity-0.1.0-py3-none-any.whl.
File metadata
- Download URL: medplexity-0.1.0-py3-none-any.whl
- Upload date:
- Size: 18.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.10 Darwin/22.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
33144460c913bfe32978870c52aab889075a79027c99f7109f883b825eb2fe38
|
|
| MD5 |
1b1936649dcf0088181e3cc5db672a47
|
|
| BLAKE2b-256 |
f85806ac8ffab15d46d814fdb42957d4da18830672e7815d749ecef293e6ebe2
|
