EHRmonize

Welcome to EHRmonize, a Python package to abstract medical concepts using large language models.

Suggested Citation

Matos, J., Gallifant, J., Pei, J., & Wong, A. I. (2024). EHRmonize: A framework for medical concept abstraction from electronic health records using large language models. arXiv. https://arxiv.org/abs/2407.00242

@article{
    matos2024ehrmonize,
      title={EHRmonize: A Framework for Medical Concept Abstraction from Electronic Health Records using Large Language Models}, 
      author={João Matos and Jack Gallifant and Jian Pei and A. Ian Wong},
      year={2024},
      eprint={2407.00242},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2407.00242}, 
}

Documentation

For documentation, please see: https://ehrmonize.readthedocs.io/. We are currently working on a demo that will soon be available on Google Colaboratory.

Motivation

Processing and harmonizing the vast amounts of data captured in complex electronic health records (EHR) is a challenging and costly task that requires clinical expertise. Large language models (LLMs) have shown promise in various healthcare-related tasks. We herein introduce EHRmonize, a framework designed to abstract EHR medical concepts using LLMs.

Rationale

EHRmonize is designed with two main components: a corpus generation and an LLM inference pipeline. The first step entails querying the EHR databases to extract and the text/concepts across various data domains that need categorization. The second step employs LLM few-shot prompting across different tasks. The objective is to leverage the vast medical text exposure of LLMs to convert raw input medication data into useful, predefined classes.

Dataset

Our curated and labeled dataset is accessible on HuggingFace.

Current supported tasks

Current supported models / engines / APIs