Skip to main content

Compute ROC AUC and confidence intervals using DeLong’s method

Project description

📖 pAUC

PyPI Python Tests

A simple Python package to calculate ROC AUC confidence intervals using DeLong’s method.


📌 Installation

pip install pauc

📌 Quick Usage

from pauc import roc_auc_ci_score
import numpy as np

y_true = np.array([0, 0, 1, 1, 0, 1])
y_pred = np.array([0.1, 0.35, 0.4, 0.8, 0.2, 0.75])

auc, (lb, ub) = roc_auc_ci_score(y_true, y_pred)
print(f'AUC: {auc:.3f}, 95% CI: ({lb:.3f}, {ub:.3f})')
AUC: 0.889
95% CI: (0.596, 1.000)

📌 Comparing Two Models

from pauc.roc_auc_ci import delong_roc_test
import numpy as np

y_true = np.array([0, 0, 1, 1, 0, 1])
pred1 = np.array([0.1, 0.35, 0.4, 0.8, 0.2, 0.75])
pred2 = np.array([0.05, 0.2, 0.3, 0.6, 0.4, 0.65])

log_pval = delong_roc_test(y_true, pred1, pred2)
p_value = 10 ** log_pval
print(f"DeLong’s test p-value: {p_value:.5f}")

📌 Why DeLong’s Test?

DeLong’s method (DeLong et al. 1988, Sun and Xu 2014) is:

  • 📈 Statistically robust and widely used
  • ✅ Ideal for estimating AUC confidence intervals
  • 🔁 Suitable for comparing correlated ROC curves

📌 Citation

If you use pAUC, please cite:

  • DeLong et al., Biometrics, 1988:
    Comparing the areas under two or more correlated ROC curves: a nonparametric approach

  • Sun & Xu, IEEE Signal Processing Letters, 2014:
    Fast Implementation of DeLong’s Algorithm for Comparing the Areas Under Correlated ROC Curves


📌 License

Released under the MIT License.


Enjoy using pAUC for statistically sound AUC comparisons!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pauc-0.1.2.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pauc-0.1.2-py3-none-any.whl (5.0 kB view details)

Uploaded Python 3

File details

Details for the file pauc-0.1.2.tar.gz.

File metadata

  • Download URL: pauc-0.1.2.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for pauc-0.1.2.tar.gz
Algorithm Hash digest
SHA256 fe15ce52e8b35aa315c9faba89152a81bbfd6778ddd1f0b7b31ff2baa3fc2531
MD5 a0e271e8466923900060e5dcb8fc2a77
BLAKE2b-256 abc2469ff5e04a11da93d68a19f4be4d17758958f0d3fa5739a6b203ca75c4a2

See more details on using hashes here.

File details

Details for the file pauc-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: pauc-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 5.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for pauc-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 62428d0ca07d6a52fd16dfef5c549a552c302c01ba69573358b612aea497da55
MD5 c6aeb029dd54d2195116c51727e26965
BLAKE2b-256 4ca193f6f5c1c74e7e6dcd895ed24a14d3d0d09abff6f1190f4b0f4af3656a3b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page