QMAP benchmark and toolkit
A domain-specific homology aware benchmark that ensure robust performance evaluation and comparison between models predicting MIC and/or HC50 (regression).
Features:
- Regression on consensus bacterial MIC and mammal HC50
- Predefined splits, to ensure comparability
- N-terminal acetylation and C-terminal amidation
- Common noncannonical amino acids O: Ornithine and B: 2,4-Diaminobutyric acid
- Non-cannonical peptides as SMILES
- Intrachain bonds:
- Machine learning ready dataset
- Extendable training dataset, so you can use your own data.
Install QMAP-benchmark
pip install qmap-benchmark
Get started
# Import the DBAASP training dataset and the benchmark
from qmap import QMAPBenchmark, DBAASPDataset, train_test_split
dataset = DBAASPDataset()
# We need to test on each split, and train on an independent set for each split.
for split in range(5):
benchmark = QMAPBenchmark(split=split)
train_mask = benchmark.get_train_mask(dataset.sequences)
train_dataset = dataset[train_mask]
train_dataset, val_dataset = train_test_split(train_dataset, test_size=0.15, random_state=42)
# Train on train_dataset ...
...
# Predict the benchmark dataset
preds = ...
# The benchmark automatically computes the metrics!
test_perf = benchmark.compute_metrics(preds)
print(test_perf)
Leaderboard
Add an entry:
Here is the leaderboard. Please open an issue to add your model to the leaderboard with the code to reproduce the results, and the reference paper.
Full - e. coli
| Method | Year | e. coli min PCC | e. coli mean | e. coli max PCC | Source Code |
|---|---|---|---|---|---|
| Linear model on ESM2 embeddings | N/A | 0.32. | 0.36 | 0.41 | eval_prev_works/Linear |
| J. Witten and Z. Witten | 2019 | 0.47 | 0.51 | 0.56 | eval_prev_works/Antimicrobial-Peptides |
| J. Cai et al | 2025 | 0.47 | 0.52 | 0.56 | eval_prev_works/AMP_regression_EC_SA |
High efficiency - e. coli
| Method | Year | e. coli min PCC | e. coli mean | e. coli max PCC | Source Code |
|---|---|---|---|---|---|
| Linear model on ESM2 embeddings | N/A | 0.06 | 0.16 | 0.22 | eval_prev_works/Linear |
| J. Witten and Z. Witten | 2019 | 0.10 | 0.22 | 0.33 | eval_prev_works/Antimicrobial-Peptides |
| J. Cai et al | 2025 | 0.20 | 0.29 | 0.33 | eval_prev_works/AMP_regression_EC_SA |
Full - hc50
| Method | Year | e. coli min PCC | e. coli mean | e. coli max PCC | Source Code |
|---|---|---|---|---|---|
| Linear model on ESM2 embeddings | N/A | -0.18 | 0.07 | 0.29 | eval_prev_works/HemoLinear |
Documentation
The documentation formatted as markdown is available in QMAP/docs/references
Examples are shown in QMAP/docs/examples
Please Cite
Please cite us if you find yourself using our work
@misc{lavertu_qmap_2026,
title = {{QMAP}: {A} {Benchmark} for {Standardized} {Evaluation} of {Antimicrobial} {Peptide} {MIC} and {Hemolytic} {Activity} {Regression}},
url = {https://www.biorxiv.org/content/10.64898/2026.02.03.703041v1},
doi = {10.64898/2026.02.03.703041},
publisher = {bioRxiv},
author = {Lavertu, Anthony and Corbeil, Jacques and Germain, Pascal},
month = feb,
year = {2026}
}
Metadata
Release files for qmap-benchmark 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| qmap_benchmark-0.1.1.tar.gz | 30.2 kB | Details |
Built distributions (wheels)
Total release size: 65.0 MB
Release files / qmap_benchmark-0.1.1.tar.gz
| Download URL | qmap_benchmark-0.1.1.tar.gz |
|---|---|
| Size | 30.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4ea42fee8d004596a6d442174cd812e8a066b2fce3c1439104c8054a3cbde94e
|
|
BLAKE2b-256 checksum How to use checksums |
c2e640c6c9316b4bbf462100a257eef2ee88e7de38afb3af31d97d94d0c9a99b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp314-cp314-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp314-cp314-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.14 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
35b7cd628414db67494aae08283ebe91eb6ab118c251d56d3b25c727ec540dcd
|
|
BLAKE2b-256 checksum How to use checksums |
a9efdc317318748d007528b8020f11d048ff90e242848f945188299a2fd43128
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp314-cp314-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp314-cp314-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.14 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
33f6e4d3a7b1897caa83aea798c8bc2e2c3f5bd40388a493d1cc95097c1d69ca
|
|
BLAKE2b-256 checksum How to use checksums |
48579e48e2d160e35124641ffa1a9fde6692c137175af96a04ba6524b4b58951
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp314-cp314-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp314-cp314-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.14 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
58b4130fdc1ca5b6dd9560e60d221f369dcc1aed59ef16f918677577d1a677e3
|
|
BLAKE2b-256 checksum How to use checksums |
516b3030c9abd0d9c1b72ae568654750a71a22b3d7f3daa7cbb8d6e25cdf7b1e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp314-cp314-macosx_10_15_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp314-cp314-macosx_10_15_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.14 macOS 10.15+ x86-64 |
|
SHA-256 checksum How to use checksums |
a7e93b34829d85b5e64369cb4850d9387dc2e649419aef78f7b70e3292092cb1
|
|
BLAKE2b-256 checksum How to use checksums |
dd76907f2466384a5275e74b3b4cee7fd7efb30f141760f3851dd07965519dd7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp313-cp313-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp313-cp313-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.13 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
19b16f093a7f312419518a243baa219beb6944e65d8e94d055771d2a40d9bf5f
|
|
BLAKE2b-256 checksum How to use checksums |
e4955411cb0054a2114aeed60b6e07938894cdc6f815f07f4a253b5176201833
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp313-cp313-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp313-cp313-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.13 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
825174a59b0467b786d75f4e1527aae23b344f5318575314954651486f8604f2
|
|
BLAKE2b-256 checksum How to use checksums |
99a3cfcb39727ee2bdf5e8021f93eef8c7b74d86f56c5b235fb9d05d8bbdd6e3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp313-cp313-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp313-cp313-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.13 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
a62e638ed7ea7114c1892096e1b2159968f999565ebb3bc5043c3725fed7b223
|
|
BLAKE2b-256 checksum How to use checksums |
16c96ca07f1da3e9c8a6d2148f0d562379fb57866f7fdf75af232ffa5ff996ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp313-cp313-macosx_10_14_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp313-cp313-macosx_10_14_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.13 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
1826f93734b52b5108fe4a7735ebccb690e3d8cb2ce1eac405c0b5dd0c739f81
|
|
BLAKE2b-256 checksum How to use checksums |
cb784613cda20d4a5f88aef29bf40984bd1731e70598550d444e85182d15d344
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp312-cp312-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp312-cp312-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.12 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
91c85a29ac73e89e09e4710c3cf6815e55dc49566f73c793ffa64ff251016d01
|
|
BLAKE2b-256 checksum How to use checksums |
d5e97e49a90882e30a48b0ec35b2ebfcf7ca8e28ff5d8e815996cb30d62e3b7c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp312-cp312-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp312-cp312-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.12 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
dd2933113884073c6c4883f31a3bde81b5a673e330569822b956086a40a7c69e
|
|
BLAKE2b-256 checksum How to use checksums |
d47c12d04e1796ddff753a5e50c3f5cfc3c7a2ad785ee9b4aed5ca73af451d7a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp312-cp312-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp312-cp312-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.12 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
afe2048b437ad7258956d50b94c21fd567ed6bec7f601dca4fd725c4f76fa1d6
|
|
BLAKE2b-256 checksum How to use checksums |
0ae860263c79462380ef4ed2afcc0fa24c294ac61a3b47dc3d132da91ec27b49
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp312-cp312-macosx_10_14_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp312-cp312-macosx_10_14_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.12 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
e592fa8d06d25474f02ee21a757149e82cf6fe1fe65fa0b070a43f617b1c9db9
|
|
BLAKE2b-256 checksum How to use checksums |
58d773889a447ab27100597de9c4ba6b13e237c239cdf82d518cce90d06420c6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp311-cp311-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp311-cp311-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.11 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
b0126a96c0cfac65895f3d3481022f25b3e8205e87fea7fd167af1a97818a72f
|
|
BLAKE2b-256 checksum How to use checksums |
c7077ae001b62a40ba58639039af53676cb98a3057bdb604fe7e0e87fca903fd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp311-cp311-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp311-cp311-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.11 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
6a447ff42778692a0f1e5f19e7b994196821378b7bac27f1c649b5bedd42f8e7
|
|
BLAKE2b-256 checksum How to use checksums |
176a88c72e9c2d453f0c7a6f27820cc6667fc33b5aa4b50643c951f7ad4f01dc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp311-cp311-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp311-cp311-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.11 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
b7c5e2e7486110b68a06f30b25657758f061c1eedc379f8dbcd14ec219945c69
|
|
BLAKE2b-256 checksum How to use checksums |
79b2665bfc24b2d56eb279c86c16111444aef3dfe48526eaef2c22f2056c7bdb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp311-cp311-macosx_10_14_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp311-cp311-macosx_10_14_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.11 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
298ddbff92550ba4fdaeb149d5964ddc05d55c60cf14595cc1a90631586377cd
|
|
BLAKE2b-256 checksum How to use checksums |
b5df2fe3ec85148d6e4e4842a82588a0d4069fce5200ce7b4e1c7b0c49b2b46b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp310-cp310-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp310-cp310-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.10 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
d14e8c57f2e0195f504fcc0704ec64f6f2172ba9f62004c9ad5dcccd40295a6f
|
|
BLAKE2b-256 checksum How to use checksums |
039e0718921a40dc8227e3010930ea201b5138faa98d94c567a5c7d3f7ab738a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp310-cp310-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp310-cp310-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.10 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
795e2b6c8a0746e84f29a77d241aa7ebb3b45ca56c6246e5a7c7827ca48d46a0
|
|
BLAKE2b-256 checksum How to use checksums |
4d1856e8e299b6c63f4dc179e4a292319ac07af217a0a9207798ee9d8fb9d77d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp310-cp310-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp310-cp310-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.10 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
5e26ab1cd44ab30420f9fa707113c8552b94344d2eb2992727819d29660590be
|
|
BLAKE2b-256 checksum How to use checksums |
27e2461615f53e5d0236e7a60d67b3b0c743327927d0417026da2c1c68eec623
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp310-cp310-macosx_10_14_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp310-cp310-macosx_10_14_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.10 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
22ca1a6eaa6cd39c4f9157bd191acce040467c9f897896372872e70cf641fe7c
|
|
BLAKE2b-256 checksum How to use checksums |
e397cf7a0d5baef418e1146ee5abcc567c6a7ef765fdd5ccb1c012d399e75b31
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp39-cp39-win_amd64.whl
| Download URL | qmap_benchmark-0.1.1-cp39-cp39-win_amd64.whl |
|---|---|
| Size | 3.0 MB |
| Tags | CPython 3.9 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
e1d5adaf0d807e8bcb16f5fde193f8ebf6c230d0ecf14ccc6480a657285607eb
|
|
BLAKE2b-256 checksum How to use checksums |
19a94ec5aa5b869333ba65f3698054c28dfaa8bf172f88423857f634cd51b221
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp39-cp39-manylinux_2_28_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp39-cp39-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 3.7 MB |
| Tags | CPython 3.9 Linux glibc 2.28+ x86-64 |
|
SHA-256 checksum How to use checksums |
4923bb483410a9d6f051ead0308a2278d428f1a5356a62f117d2acce3166fd80
|
|
BLAKE2b-256 checksum How to use checksums |
49975e4aa158f22bc5d16d10c25ae325fdc20db1eeade3fa2c9cebc831d0c8b2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp39-cp39-macosx_11_0_arm64.whl
| Download URL | qmap_benchmark-0.1.1-cp39-cp39-macosx_11_0_arm64.whl |
|---|---|
| Size | 1.3 MB |
| Tags | CPython 3.9 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
f1dbcce4c6aed1f1bf661f0e0c5b1393f9886dec7fbcee9130ee18c047749339
|
|
BLAKE2b-256 checksum How to use checksums |
0183e938ccbd2ba151352ce1bf363716708ebb3b0ec2426f5adddc4624b297ac
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|
Release files / qmap_benchmark-0.1.1-cp39-cp39-macosx_10_14_x86_64.whl
| Download URL | qmap_benchmark-0.1.1-cp39-cp39-macosx_10_14_x86_64.whl |
|---|---|
| Size | 2.9 MB |
| Tags | CPython 3.9 macOS 10.14+ x86-64 |
|
SHA-256 checksum How to use checksums |
393dac5c22da79d4fe8c368c952aac9cc7c4a1471349be0e27c88352b561c20d
|
|
BLAKE2b-256 checksum How to use checksums |
235d302700546a1b4a78b5eb28cf91e93c7e6cee7e331e7bf4c575cfedfc7020
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.13.7
|