Skip to main content

Code for Categorical Reparameterization using Denoising Diffusion models at https://arxiv.org/abs/2601.00781

Project description

ReDGE

Code for Categorical Reparameterization using Denoising Diffusion models (arXiv:2601.00781).

Implemented samplers

  • redge
  • redge_cov
  • reindge
  • st
  • gumbel
  • reinmax

Public API

We provide a simple API for sampling from ReDGE-style samplers:

from redge import redge, SAMPLERS

x = redge(logits, n_steps=5, t_1=0.5, hard=True)
y = SAMPLERS["redge"](logits, n_steps=5, t_1=0.5, hard=True)

Hyperparameters and tuning

ReDGE-style samplers expose two main knobs:

  • n_steps (int): number of DDIM reverse steps
  • t_1 (float): diffusion endpoint / relaxation strength (eqiuvalent to the temperature in Gumbel-based samplers)

Practical defaults:

  • n_steps: 3-9 (start with 5)
  • t_1: 0.3-0.9 (start with 0.5)

Guidelines:

  • If optimization is unstable/noisy, increase t_1
  • If samples are too soft/biased, decrease t_1 or increase n_steps slightly

Citation

If you use this repository, please cite:

@article{gourevitch2026redge,
  title={Categorical Reparameterization with Denoising Diffusion models},
  author={Samson Gourevitch and Alain Durmus and Eric Moulines and Jimmy Olsson and Yazid Janati},
  year={2026},
  eprint={2601.00781},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2601.00781}
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

redge-0.1.0.tar.gz (6.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

redge-0.1.0-py3-none-any.whl (7.0 kB view details)

Uploaded Python 3

File details

Details for the file redge-0.1.0.tar.gz.

File metadata

  • Download URL: redge-0.1.0.tar.gz
  • Upload date:
  • Size: 6.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.15

File hashes

Hashes for redge-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0ac426fa748bd38f2834ca982dbd23d104b8f4eeb5e5b0ad4975d0c015a8b9ee
MD5 507a2f2a0cb7794870d5df877b9ff694
BLAKE2b-256 49479b0721f1f7b1ed4a82b54c9dc2c3b2c9d84e5bb9cd3d657c8e96ae38476b

See more details on using hashes here.

File details

Details for the file redge-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: redge-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 7.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.15

File hashes

Hashes for redge-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ca6f3aa5a86c13d8c33f89da455ea51fd19538784bc055e29d023dc5906d465d
MD5 9da23bb2c7363079df53f7706e1308ef
BLAKE2b-256 2fc308362c89807c5a7616bb7497124298430f81ed02f8d19897708fa6e06c5a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page