Skip to main content

PyTorch-based regressors with uncertainty quantification and scikit-learn interface

Project description

PyPI - Version Python Tests

UQRegressors

UQRegressors is a Python library for regression models that provide prediction intervals, in addition to point estimates. It is meant for machine learning applications where quantifying uncertainty is important. Full documentation is available at: https://arjunrs3.github.io/UQRegressors/.

It features highly customizable parameters for each model, an easy to use interface with built-in dataset validation, GPU compatibility with a PyTorch backend, validated implementations with comparisons to published results, easy saving and loading of created models, and a wide variety of metrics and visualization tools available to assess model quality.

Please direct any questions or suggestions to the email arjunrs@stanford.edu.


Key Capabilities

  1. Dataset Loading & Validation — Utility functions to clean and validate your input data.
  2. Uncertainty‑Aware Regressors
    • Conformal: CQR, K‑Fold CQR, Ensemble‑based CQR
    • Bayesian: Deep Ensembles, MC Dropout, Gaussian Processes (GP, BBMM GP)
  3. Hyperparameter Tuning — Optuna‑based tuning with support for custom interval‑width objective functions.
  4. Uncertainty Metrics — RMSE, coverage, interval width, interval score, NLL, correlation diagnostics, conditional coverage, RMSCD variants, and more.
  5. Visualization Tools — Calibration curves, prediction-vs-true plots, model comparison bar charts.

Installation

To install the core features of UQRegressors:

pip install uqregressors

UQRegressors requires PyTorch, which you should install according to your setup:

  • CPU only:
    pip install torch torchvision torchaudio
    
  • CUDA GPU (choose the version matching your GPU):
    pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
    
  • For other versions, see PyTorch Install Guide.

Getting Started (More detail in full docs)

from uqregressors.bayesian.dropout import MCDropoutRegressor
from uqregressors.tuning.tuning import tune_hyperparams, interval_width
from uqregressors.plotting.plotting import plot_pred_vs_true

# Define a dataset
X_train = np.linspace(0, 1, 5)
X_test = np.linspace(0, 1, 40)
y_train = np.sin(2 * np.pi * X_train)
y_test = np.sin(2 * np.pi * X_test)

# Train an MC‑Dropout regressor
reg = MCDropoutRegressor(epochs=50, random_seed=42)
reg.fit(X_train, y_train)
mean, lower, upper = reg.predict(X_test)

# Visualize results
plot_pred_vs_true(mean, lower, upper, y_test, show=True, title="MC‑Dropout")

# Hyperparameter tuning example (e.g., tuning CQR)
from uqregressors.conformal.cqr import ConformalQuantileRegressor
cqr = ConformalQuantileRegressor(alpha=0.1, epochs=20, random_seed=42)

opt_cqr, best_score, study = tune_hyperparams(
    regressor=cqr,
    param_space={"tau_lo": lambda t: t.suggest_float("tau_lo", 0.01, 0.1),
                 "tau_hi": lambda t: t.suggest_float("tau_hi", 0.9, 0.99)},
    X=X_train, y=y_train,
    score_fn=interval_width,
    greater_is_better=False,
    n_trials=10,
    n_splits=3
)
mean_t, lo_t, hi_t = opt_cqr.predict(X_test)
plot_pred_vs_true(mean_t, lo_t, hi_t, y_test, show=True, title="Tuned CQR")

Documentation

See the complete API Documentation with complete examples:
https://arjunrs3.github.io/UQRegressors/


Contributing

Contributions, issues, and feature requests are welcome! Please:

  1. Fork the repo
  2. Create a feature branch (git checkout -b my-feature)
  3. Commit your changes and push
  4. Open a Pull Request
  5. Email arjunrs@stanford.edu with any questions

License

MIT License


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

uqregressors-1.0.11.tar.gz (12.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

uqregressors-1.0.11-py3-none-any.whl (74.6 kB view details)

Uploaded Python 3

File details

Details for the file uqregressors-1.0.11.tar.gz.

File metadata

  • Download URL: uqregressors-1.0.11.tar.gz
  • Upload date:
  • Size: 12.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for uqregressors-1.0.11.tar.gz
Algorithm Hash digest
SHA256 0581c31bd4f93bddc0afac04d22f023b8fd0418ba5b82b4067996dab0f65efe7
MD5 ae634d6725fef16c0422030c4630de2c
BLAKE2b-256 b524d479ab640254321220c0495035352389bcfeba2232b582f761ac2d0442c6

See more details on using hashes here.

File details

Details for the file uqregressors-1.0.11-py3-none-any.whl.

File metadata

  • Download URL: uqregressors-1.0.11-py3-none-any.whl
  • Upload date:
  • Size: 74.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.0

File hashes

Hashes for uqregressors-1.0.11-py3-none-any.whl
Algorithm Hash digest
SHA256 40d5337f0b1ed642537fafc7e407a7fb6bac7577ddf4bfd8b167678ef9da8d26
MD5 56c441583ef9bd2a02e526a12accfb29
BLAKE2b-256 4e45d3ba3e63e410d37b87800dd17a109f21821d01fd7d12524d2fe659a86410

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page