Skip to main content

PyTorch-based regressors with uncertainty quantification and scikit-learn interface

Project description

PyPI - Version Python Tests

UQRegressors

UQRegressors is a Python library for regression models that provide prediction intervals, in addition to point estimates. It is meant for machine learning applications where quantifying uncertainty is important.

It features highly customizable parameters for each model, an easy to use interface with built-in dataset validation, GPU compatibility with a PyTorch backend, validated implementations with comparisons to published results, easy saving and loading of created models, and a wide variety of metrics and visualization tools available to assess model quality.

Please direct any questions or suggestions to the email arjunrs@stanford.edu.


Key Capabilities

  1. Dataset Loading & Validation — Utility functions to clean and validate your input data.
  2. Uncertainty‑Aware Regressors
    • Conformal: CQR, K‑Fold CQR, Ensemble‑based CQR
    • Bayesian: Deep Ensembles, MC Dropout, Gaussian Processes (GP, BBMM GP)
  3. Hyperparameter Tuning — Optuna‑based tuning with support for custom interval‑width objective functions.
  4. Uncertainty Metrics — RMSE, coverage, interval width, interval score, NLL, correlation diagnostics, conditional coverage, RMSCD variants, and more.
  5. Visualization Tools — Calibration curves, prediction-vs-true plots, model comparison bar charts.

Installation

To install the core features of UQRegressors:

pip install uqregressors

UQRegressors requires PyTorch, which you should install according to your setup:

  • CPU only:
    pip install torch torchvision torchaudio
    
  • CUDA GPU (choose the version matching your GPU):
    pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
    
  • For other versions, see PyTorch Install Guide.

Getting Started (More detail in full docs)

from uqregressors.bayesian.dropout import MCDropoutRegressor
from uqregressors.tuning.tuning import tune_hyperparams, interval_width
from uqregressors.plotting.plotting import plot_pred_vs_true

# Define a dataset
X_train = np.linspace(0, 1, 5)
X_test = np.linspace(0, 1, 40)
y_train = np.sin(2 * np.pi * X_train)
y_test = np.sin(2 * np.pi * X_test)

# Train an MC‑Dropout regressor
reg = MCDropoutRegressor(epochs=50, random_seed=42)
reg.fit(X_train, y_train)
mean, lower, upper = reg.predict(X_test)

# Visualize results
plot_pred_vs_true(mean, lower, upper, y_test, show=True, title="MC‑Dropout")

# Hyperparameter tuning example (e.g., tuning CQR)
from uqregressors.conformal.cqr import ConformalQuantileRegressor
cqr = ConformalQuantileRegressor(alpha=0.1, epochs=20, random_seed=42)

opt_cqr, best_score, study = tune_hyperparams(
    regressor=cqr,
    param_space={"tau_lo": lambda t: t.suggest_float("tau_lo", 0.01, 0.1),
                 "tau_hi": lambda t: t.suggest_float("tau_hi", 0.9, 0.99)},
    X=X_train, y=y_train,
    score_fn=interval_width,
    greater_is_better=False,
    n_trials=10,
    n_splits=3
)
mean_t, lo_t, hi_t = opt_cqr.predict(X_test)
plot_pred_vs_true(mean_t, lo_t, hi_t, y_test, show=True, title="Tuned CQR")

Documentation

See the complete API Documentation with complete examples:
https://arjunrs3.github.io/UQRegressors/


Contributing

Contributions, issues, and feature requests are welcome! Please:

  1. Fork the repo
  2. Create a feature branch (git checkout -b my-feature)
  3. Commit your changes and push
  4. Open a Pull Request
  5. Email arjunrs@stanford.edu with any questions

License

MIT License


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

uqregressors-1.0.3.tar.gz (14.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

uqregressors-1.0.3-py3-none-any.whl (57.7 kB view details)

Uploaded Python 3

File details

Details for the file uqregressors-1.0.3.tar.gz.

File metadata

  • Download URL: uqregressors-1.0.3.tar.gz
  • Upload date:
  • Size: 14.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.1

File hashes

Hashes for uqregressors-1.0.3.tar.gz
Algorithm Hash digest
SHA256 81d862b975ccef5b1c73a6f1360169605e220c43e7d88779d6f05a4143ee9724
MD5 9ccf3d355e4100ccfe2f506e45c88245
BLAKE2b-256 a51ce99bbc48dde8c9e6e35d245f0f7450f948c72c7e00ca22e1ffc8830bcfca

See more details on using hashes here.

File details

Details for the file uqregressors-1.0.3-py3-none-any.whl.

File metadata

  • Download URL: uqregressors-1.0.3-py3-none-any.whl
  • Upload date:
  • Size: 57.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.1

File hashes

Hashes for uqregressors-1.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b1872b232a08081e8cc1a37b894847b94a0728a7f31348d1728c0aa9eb95c589
MD5 e3c2c805f63f2142cd0815e0137775b5
BLAKE2b-256 dbbc44ef5e41e4e3f01388aa9d5bfb094331d6517954cecf8dd9beaba67e6732

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page