Skip to main content

PyTDC: A multimodal machine learning training, evaluation, and inference platform for biomedical foundation models

Project description

logo


website PyPI version License: MIT Python Downloads Downloads GitHub Repo stars GitHub Repo stars

Conda Github Actions Build License: MIT

ICML 2025 Paper | NeurIPS 2024 AIDrugX Paper

Introducing PyTDC

Existing biomedical benchmarks do not provide end-to-end infrastructure for training, evaluation, and inference of models that integrate multimodal biological data and a broad range of machine learning tasks in therapeutics. We present PyTDC, an open-source machine-learning platform providing streamlined training, evaluation, and inference software for multimodal biological AI models. PyTDC unifies distributed, heterogeneous, continuously updated data sources and model weights and standardizes benchmarking and inference endpoints.

The components of PyTDC include:

  • A collection of multimodal, continually updated heterogeneous data sources is unified under the introduced "API-first-dataset" architecture. Inspired by API-first design, this microservice architecture uses the model-view-controller design pattern to enable multimodal data views.
  • PyTDC presents open-source model retrieval and deployment software that streamlines AI inferencing and exposes state-of-the-art, research-ready models and training setups for biomedical representation learning models across modalities.
  • We integrate single-cell analysis with multimodal machine learning in therapeutics via the introduction of contextualized tasks.

workflow

We present PyTDC, a machine-learning platform providing streamlined training, evaluation, and inference software for single-cell biological foundation models to accelerate research in transfer learning method development in therapeutics. PyTDC introduces an API-first architecture that unifies heterogeneous, continuously updated data sources. The platform introduces a model server, which provides unified access to model weights across distributed repositories and standardized inference endpoints. The model server accelerates research workflows by exposing state-of-the-art, research-ready models and training setups for biomedical representation learning models across modalities. Building upon Therapeutic Data Commons, we present single-cell therapeutics tasks, datasets, and benchmarks for model development and evaluation.

[Learn More]

Built on the Therapeutics Data Commons (TDC)

PyTDC has forked from Therapeutics Data Commons, a datasets store with ml-ready-datasets in 66 tasks- https://github.com/mims-harvard/TDC

Key PyTDC Presentations and Publications

[0] Western Bioinformatics Seminar Series: Alejandro Velez-Arce, "Signals in the Cells: Multimodal and Contextualized Machine Learning Foundations for Therapeutics." [Event] [Seminar] [Slides]

[1] Velez-Arce, Huang, Li, Lin, et al., Signals in the Cells: Multimodal and Contextualized Machine Learning Foundations for Therapeutics, NeurIPS AIDrugX, 2024 [Paper] [Slides] [Webpage]

Installation

Using pip

To install the core environment dependencies of TDC, use pip:

pip install pytdc-nextml

Cite Us

If you find PyTDC useful, cite our ICML paper and NeurIPS paper:

@inproceedings{
velez-arce2025pytdc,
title={Py{TDC}: A multimodal machine learning training, evaluation, and inference platform for biomedical foundation models},
author={Alejandro Velez-Arce and Marinka Zitnik},
booktitle={Forty-second International Conference on Machine Learning},
year={2025},
url={https://openreview.net/forum?id=HV8vZDDoYc}
}
@inproceedings{
velez-arce2024signals,
title={Signals in the Cells: Multimodal and Contextualized Machine Learning Foundations for Therapeutics},
author={Alejandro Velez-Arce and Xiang Lin and Kexin Huang and Michelle M Li and Wenhao Gao and Bradley Pentelute and Tianfan Fu and Manolis Kellis and Marinka Zitnik},
booktitle={NeurIPS 2024 Workshop on AI for New Drug Modalities},
year={2024},
url={https://openreview.net/forum?id=kL8dlYp6IM}
}

PyTDC is built on top of other open-sourced projects. Additionally, please cite the original work if you used these datasets/functions in your research. You can find the original paper for the function/dataset on the website. For older datasets, please cite the paper:

@article{Huang2021tdc,
  title={Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Development},
  author={Huang, Kexin and Fu, Tianfan and Gao, Wenhao and Zhao, Yue and Roohani, Yusuf and Leskovec, Jure and Coley,
          Connor W and Xiao, Cao and Sun, Jimeng and Zitnik, Marinka},
  journal={Proceedings of Neural Information Processing Systems, NeurIPS Datasets and Benchmarks},
  year={2021}
}

Data Server

Many PyTDC datasets are hosted on Harvard Dataverse with the following persistent identifier https://doi.org/10.7910/DVN/21LKWG. When Dataverse is under maintenance, PyTDC datasets cannot be retrieved. That happens rarely; please check the status on the Dataverse website.

License

The PyTDC codebase is licensed under the MIT license. For individual dataset usage, please refer to the dataset license on the website.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pytdc_nextml-1.2.0.tar.gz (176.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pytdc_nextml-1.2.0-py3-none-any.whl (226.9 kB view details)

Uploaded Python 3

File details

Details for the file pytdc_nextml-1.2.0.tar.gz.

File metadata

  • Download URL: pytdc_nextml-1.2.0.tar.gz
  • Upload date:
  • Size: 176.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pytdc_nextml-1.2.0.tar.gz
Algorithm Hash digest
SHA256 187a46d52fbac05d9d37052f00db54616f97912b958f5287cd98fb3cf1dbe129
MD5 a46188edefa0c572e813b73e6cabadcd
BLAKE2b-256 5851f2ff9b97d5b10cd9820d2d4099c11ec32dbe4068c980203510b37ed56712

See more details on using hashes here.

File details

Details for the file pytdc_nextml-1.2.0-py3-none-any.whl.

File metadata

  • Download URL: pytdc_nextml-1.2.0-py3-none-any.whl
  • Upload date:
  • Size: 226.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pytdc_nextml-1.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 4405d142d2aed2f59ebe352af52d50d5d1bdd05a2f4fa64c695baf5412aea70d
MD5 b2dc22288a1731da6a3792387cca5510
BLAKE2b-256 3caba5f5f32d3d10f3a944b1cd710f7f2ef793719fc37895c5d6100ef85de9b4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page