Skip to main content

Instance noise reduction framework based on Deep Learning gradients agnostic to the network architecture.

Project description

DenoGrad: Deep Gradient Denoising Framework

arXiv Python License

📄 Description

DenoGrad is a novel gradient-based denoising framework designed to enhance the robustness and performance of Artificial Intelligence models, with a specific focus on interpretable (white-box) models.

Unlike conventional techniques that simply remove noisy instances or significantly alter the data distribution, DenoGrad leverages the gradients of a reference Deep Learning (DL) model—trained on the target data—to dynamically detect and correct noisy samples.

🚀 Key Features

  • Gradient-Based Correction: Utilizes gradient information from deep models to guide the noise reduction process effectively.
  • Distribution Preservation: Corrects instances while maintaining the original data distribution, avoiding oversimplification of the problem space.
  • Task Agnostic: Validated effectively on both tabular data and time-series datasets.
  • Interpretable AI Enhancement: Specifically engineered to boost the performance of interpretable models in noisy environments without sacrificing transparency.

🛠️ Installation

pip install denograd

📖 Basic Usage

import torch
import torch.nn as nn
from denograd import DenoGrad

# Initialize the denoiser with your reference model
denoiser = DenoGrad(
    model=my_deep_model, # DL model fitted to noisy data
    criterion=nn.MSELoss(),
)

# 1. Fit the noisy data
# For Tabular Data
denoiser.fit(
    X=x_noisy, 
    y=y_noisy, 
    is_ts=False
)

# For Time Series (requires window_size)
# denoiser.fit(
#    X=x_noisy,
#    y=['y'],
#    is_ts=True,
#    window_size=24,
#    future=1,
#    stride=1
# )

# 2. Denoise the dataset
x_clean, y_clean, x_gradients, y_gradients = denoiser.transform(
    nrr = 0.05, # Noise Reduction Rate. Same functionality as learning rate but for denoising porposes.
    nr_threshold = 0.01, # "Level" of noise allowed.
    max_epochs = 200, # Max number of epochs to perform the denoising process.
    denoise_y = True, # Enable denoising for the target variable (recommended for Tabular).
    batch_size = 1024,
    save_gradients = True # Save all the gradients calculated through the denoising process.
)

📝 Citation

If you use DenoGrad in your research, please cite our paper:

@article{denograd2025, title={DenoGrad: Deep Gradient Denoising Framework for Enhancing the Performance of Interpretable AI Models}, author={Alonso-Ramos, J. Javier and [Other Authors]}, journal={arXiv preprint arXiv:2511.10161}, year={2025} }

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

denograd-1.0.0b3.tar.gz (20.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

denograd-1.0.0b3-py3-none-any.whl (20.6 kB view details)

Uploaded Python 3

File details

Details for the file denograd-1.0.0b3.tar.gz.

File metadata

  • Download URL: denograd-1.0.0b3.tar.gz
  • Upload date:
  • Size: 20.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.11.5

File hashes

Hashes for denograd-1.0.0b3.tar.gz
Algorithm Hash digest
SHA256 5cb49c9bf5bf45e9cd6abe1132d1579b84ea82514bafd81ed4200c8f9c8bd06f
MD5 8f6b0dc5582035d058e7be4b378702c3
BLAKE2b-256 5e607f93d1165b3a8708b0aebe7050f454e45bdac9a7d0cbb2d32cfecb721d3e

See more details on using hashes here.

File details

Details for the file denograd-1.0.0b3-py3-none-any.whl.

File metadata

  • Download URL: denograd-1.0.0b3-py3-none-any.whl
  • Upload date:
  • Size: 20.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.11.5

File hashes

Hashes for denograd-1.0.0b3-py3-none-any.whl
Algorithm Hash digest
SHA256 3d84e5b3066598bed93820714cb16c050dd24a85c4b96669e13b2a21135a11f7
MD5 a2c8a6078358afed4e6c28ca47138f27
BLAKE2b-256 044365c5d6470e3e0f7ce0ea2399465c046d92fe93d8b940a60b7d4a4f723d88

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page