Skip to main content

Instance noise reduction framework based on Deep Learning gradients agnostic to the network architecture.

Project description

DenoGrad: Deep Gradient Denoising Framework

arXiv Python License

📄 Description

DenoGrad is a novel gradient-based denoising framework designed to enhance the robustness and performance of Artificial Intelligence models, with a specific focus on interpretable (white-box) models.

Unlike conventional techniques that simply remove noisy instances or significantly alter the data distribution, DenoGrad leverages the gradients of a reference Deep Learning (DL) model—trained on the target data—to dynamically detect and correct noisy samples.

🚀 Key Features

  • Gradient-Based Correction: Utilizes gradient information from deep models to guide the noise reduction process effectively.
  • Distribution Preservation: Corrects instances while maintaining the original data distribution, avoiding oversimplification of the problem space.
  • Task Agnostic: Validated effectively on both tabular data and time-series datasets.
  • Interpretable AI Enhancement: Specifically engineered to boost the performance of interpretable models in noisy environments without sacrificing transparency.

🛠️ Installation

pip install denograd

📖 Basic Usage

import torch
import torch.nn as nn
from denograd import DenoGrad

# Initialize the denoiser with your reference model
denoiser = DenoGrad(
    model=my_deep_model, # DL model fitted to noisy data
    criterion=nn.MSELoss(),
)

# 1. Fit the noisy data
# For Tabular Data
denoiser.fit(
    X=x_noisy, 
    y=y_noisy, 
    is_ts=False
)

# For Time Series (requires window_size)
# denoiser.fit(
#    X=x_noisy,
#    y=['y'],
#    is_ts=True,
#    window_size=24,
#    future=1,
#    stride=1
# )

# 2. Denoise the dataset
x_clean, y_clean, x_gradients, y_gradients = denoiser.transform(
    nrr = 0.05, # Noise Reduction Rate. Same functionality as learning rate but for denoising porposes.
    nr_threshold = 0.01, # "Level" of noise allowed.
    max_epochs = 200, # Max number of epochs to perform the denoising process.
    denoise_y = True, # Enable denoising for the target variable (recommended for Tabular).
    batch_size = 1024,
    save_gradients = True # Save all the gradients calculated through the denoising process.
)

📝 Citation

If you use DenoGrad in your research, please cite our paper:

@article{denograd2025, title={DenoGrad: Deep Gradient Denoising Framework for Enhancing the Performance of Interpretable AI Models}, author={Alonso-Ramos, J. Javier and [Other Authors]}, journal={arXiv preprint arXiv:2511.10161}, year={2025} }

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

denograd-1.0.0b2.tar.gz (20.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

denograd-1.0.0b2-py3-none-any.whl (20.3 kB view details)

Uploaded Python 3

File details

Details for the file denograd-1.0.0b2.tar.gz.

File metadata

  • Download URL: denograd-1.0.0b2.tar.gz
  • Upload date:
  • Size: 20.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.11.5

File hashes

Hashes for denograd-1.0.0b2.tar.gz
Algorithm Hash digest
SHA256 3ea350f3c79713c049df8097c3b6e15412755a5d3f60fde2e8f9fab0dcf0b17d
MD5 eb34ecf0773aab63d00ea9f1e9441e4a
BLAKE2b-256 cc54b590ee8204c20ec8d7a3995e8356f82a052ac299604157e101da69de5357

See more details on using hashes here.

File details

Details for the file denograd-1.0.0b2-py3-none-any.whl.

File metadata

  • Download URL: denograd-1.0.0b2-py3-none-any.whl
  • Upload date:
  • Size: 20.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.0.1 CPython/3.11.5

File hashes

Hashes for denograd-1.0.0b2-py3-none-any.whl
Algorithm Hash digest
SHA256 edc93187343ce40d0c7f5c0d582b14a402e5f03c97f3e64578c6bf9020eba8e7
MD5 ac675f8fd695ee78d6acc90fae686f0d
BLAKE2b-256 ee41ab08da4b761945cae4ca88f7174ec11923243616c545b0bbaa98773222da

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page