A multimodal AI-Ready Dataset. Updated Regularly. More details from TrialBench: Multi-Modal AI-Ready Datasets for Clinical Trial Prediction.
Project description
# TrialBench: AI-Ready Clinical Trial Datasets
<a href='https://huyjj.github.io/Trialbench/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> <a href='https://arxiv.org/pdf/2407.00631'><img src='https://img.shields.io/badge/Paper-Arxiv-red'></a>
<p align="center"><img src="./trial.pdf" alt="logo" width="810px" /></p>
This repository contains code for training and testing benchmark models on Trialbench datasets. TrialBench comprises 23 AI-ready clinical trial datasets for 8 well-defined tasks: clinical trial duration forecasting, patient dropout rate prediction, serious adverse event, all-cause mortality rate prediction, trial approval outcome prediction, trial failure reason identification, eligibility criteria design, and drug dose finding. The provided scripts facilitate the evaluation of various machine learning algorithms, enabling researchers to assess their performance on different clinical trial phases and tasks.
## 🚀 Installation
We recommend creating a dedicated virtual environment (such as conda) with Python 3.7+ to ensure consistent performance. Once your environment is ready, install the required dependencies:
```
pip install -r requirements.txt
```
## 🔩 Download
All necessary supporting documents can be downloaded from this [link](https://drive.google.com/drive/folders/1fp350IUj284EnTHVgSWtq9qIq0Mlbjg9?usp=sharing). Place them into the `data/` folder.
## 📚 Trialbench
For quick exploration, toy samples are available in [Trialbench](https://github.com/ML2Health/ML2ClinicalTrials/tree/main/Trialbench). You can also [Download All Data](https://zenodo.org/records/15455785/files/all_task.zip?download=1) at once.
#### Sub-Task Datasets
1. [Trial Duration Forecasting](https://zenodo.org/records/15455785/files/trial-duration-forecasting.zip?download=1)
2. [Patient Dropout Event Forecasting](https://zenodo.org/records/15455785/files/patient-dropout-event-forecasting.zip?download=1)
3. [Serious Adverse Event Forecasting](https://zenodo.org/records/15455785/files/serious-adverse-event-forecasting.zip?download=1)
4. [Mortality Event Prediction](https://zenodo.org/records/15455785/files/mortality-event-prediction.zip?download=1)
5. [Trial Approval Forecasting](https://zenodo.org/records/15455785/files/trial-approval-forecasting.zip?download=1)
6. [Trial Failure Reason Identification](https://zenodo.org/records/15455785/files/trial-failure-reason-identification.zip?download=1)
7. [Eligibility Criteria Design](https://zenodo.org/records/15455785/files/eligibility-criteria-design.zip?download=1)
8. [Drug Dose Finding](https://zenodo.org/records/15455785/files/drug-dose-prediction.zip?download=1)
Here’s a refined and expanded Usage section with a clear explanation of base_name and how to use it to run different experiments:
## 💻 Usage
To run an experiment for mortality rate prediction, navigate to the `AI4Trial` directory and execute:
```bash
cd AI4Trial
python learn_multi_model.py --base_name mortality_rate --phase 'Phase 1' --exp Temp
```
#### Configurable Parameters
--base_name: Specifies the task to run (see the available options below).
--phase: Defines the experimental phase (e.g., 'Phase 1').
--exp: Sets the output dir for tracking.
#### Available base_name Options
The base_name parameter determines which dataset and task to use. Below are the supported tasks:
| base_name | Task Description |
|----------------------------|-------------------------------------------------------|
| mortality_rate | Mortality event prediction |
| serious_adverse_rate | Serious adverse event forecasting |
| patient_dropout_rate | Patient dropout event forecasting |
| duration | Trial duration forecasting |
| outcome | Trial outcome prediction |
| failure_reason | Trial failure reason identification |
| serious_adverse_rate_yn | Binary classification for serious adverse events |
| patient_dropout_rate_yn | Binary classification for patient dropout events |
| mortality_rate_yn | Binary classification for mortality prediction |
| dose | Drug dose finding (regression) |
| dose_cls | Drug dose finding (classification ) |
To run experiments for other tasks, replace mortality_rate in the command with the corresponding base_name from the table above. For example, to run a serious adverse event forecasting experiment:
```
python learn_multi_model.py --base_name serious_adverse_rate --phase 'Phase 2' --exp TestRun
```
Feel free to explore different tasks by adjusting base_name, phase, and exp accordingly.
## 💼 Support
If you encounter any issues or have questions, please open an issue on [GitHub](https://github.com/ML2Health/ML2ClinicalTrials/issues). For additional help, feel free to reach out to our team.
### 📢 Citation
If you use this work in your research or projects, please cite it as follows:
```
@article{chen2024trialbench,
title={Trialbench: Multi-modal artificial intelligence-ready clinical trial datasets},
author={Chen, Jintai and Hu, Yaojun and Wang, Yue and Lu, Yingzhou and Cao, Xu and Lin, Miao and Xu, Hongxia and Wu, Jian and Xiao, Cao and Sun, Jimeng and others},
journal={arXiv preprint arXiv:2407.00631},
year={2024}
}
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
trialbench-0.3.1.tar.gz
(1.4 MB
view details)
File details
Details for the file trialbench-0.3.1.tar.gz.
File metadata
- Download URL: trialbench-0.3.1.tar.gz
- Upload date:
- Size: 1.4 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.16
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b9a7b5a91577b9d095cf5c592c0eb6ea8b8b95827509aa9161e0a3bb2795a7f3
|
|
| MD5 |
2bfbbfb18e505c0c5ff77377612775ac
|
|
| BLAKE2b-256 |
94716cb3b94956177a866efa1ff1ed9f1311fe64b22fc7c616ef4c14fc5a8fe3
|