Skip to main content

Deep learning method for removing specular reflections from RGB images.

Project description

UnReflectAnything

Project PyPI Paper Weights Demo Wiki Licence

RGB-Only Highlight Removal by Rendering Synthetic Specular Supervision

UnReflectAnything inputs any RGB image and removes specular highlights, returning a clean diffuse-only outputs. We trained UnReflectAnything by synthetizing specularities and supervising in DINOv3 feature space.

UnReflectAnything works on both natural indoor and surgical/endoscopic domain data.


examples

Installation

pip install unreflectanything

Install UnReflectAnything as a Python Package.

The minimum required Python version is 3.11, but development and all experiments have been bases on Python 3.12.

For GPU support, make sure PyTorch comes with CUDA version for your system (see PyTorch Get Started).

Setting up

After pip-installing, you can use the unreflectanything CLI command, which is also aliased to unreflect and ura. The three commands are equivalent.

With the CLI you can already download the model weights with

unreflectanything download --weights

and some sample images with

unreflectanything download --images

Weights are stored by default in ~/.cache/unreflectanything/weights (or $XDG_CACHE_HOME/unreflectanything/weights if set ; %LOCALAPPDATA%\unreflectanything for Windows). Use --output-dir to choose another location.

Both the weights and images are stored on the HuggingFace Model Repo.

Enable shell completion

Shell completion is available for the bash and zsh shells. Run

unreflectanything completion bash

and execute the echo ... command that gets printed.

Command Line Interface

Get an overview of the available CLI endpoints with

unreflectanything --help   # alias 'unreflect --help' alias 'ura --help'

Refer to the Wiki to get detailed documentation about each endpoint. We report a summary of the available subcommands. Remember that ura is aliased to the unreflectanything command

Subcommand Description Command
inference Run inference on an image directory ura inference --input /path/to/images --output /path/to/unref_images
train Run training ura train --config config_train.yaml
test Run evaluation on a trained model ura test --config config_test.yaml
download Download checkpoint weights, sample images, notebooks ura download --weights
verify Verify weights installation and compatibility, as well as dataset directory structure ura verify --dataset /path/to/dataset
evaluate Compute metrics on output data ura evaluate --output /path/to/unref_images --gt /path/to/groundtruth_images/
completion Print shell completion (bash/zsh): ura completion bash
cite Print shell completion (bash/zsh) ura cite --bibtex

Python API

The same endpoints above are exposed as a Python API. Refer to the Wiki to get detailed documentation about each endpoint. A few examples are reported below

import unreflectanything as ura
import torch

# Get the model class (e.g. for custom setup or training)
ModelClass = ura.model()

# Get a pretrained model (torch.nn.Module) and run on batched RGB
uramodel = ura.model(pretrained=True)  # uses cached weights; run 'ura download --weights' first
images = torch.rand(2, 3, 448, 448, device="cuda")  # [B, 3, H, W], values in [0, 1]
model_out = uramodel(images)  # [B, 3, H, W] diffuse tensor

# File-based or tensor-based inference (one-shot, no model handle)
ura.inference("input.png", output="output.png")
result = ura.inference(images)  # tensor input returns tensor

# Run training or testing
ura.run_pipeline(mode="train")   # or mode="test"

# Run inference from options
options = ura.InferenceOptions(
    weights_path="path/to/full_model_weights.pt",
    input_dir="path/to/input/images",
    output_dir="path/to/output/diffuse",
)
ura.run_inference(options)

Citation

If you include UnReflectAnything in your pipline or research work, we encourage you cite our work. Get the citation entry with

unreflectanything cite --bibtex

or copy it directly from below

@misc{rota2025unreflectanythingrgbonlyhighlightremoval,
      title={UnReflectAnything: RGB-Only Highlight Removal by Rendering Synthetic Specular Supervision}, 
      author={Alberto Rota and Mert Kiray and Mert Asim Karaoglu and Patrick Ruhkamp and Elena De Momi and Nassir Navab and Benjamin Busam},
      year={2025},
      eprint={2512.09583},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2512.09583}, 
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

unreflectanything-0.2.0.tar.gz (269.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

unreflectanything-0.2.0-py3-none-any.whl (284.7 kB view details)

Uploaded Python 3

File details

Details for the file unreflectanything-0.2.0.tar.gz.

File metadata

  • Download URL: unreflectanything-0.2.0.tar.gz
  • Upload date:
  • Size: 269.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.8.14

File hashes

Hashes for unreflectanything-0.2.0.tar.gz
Algorithm Hash digest
SHA256 bbacbd1afc0a2e3731d517b9ca2e3eefc71d6a0d18e05bcdb113776d43c3116b
MD5 5d6a15ff94d758069100768609c284b0
BLAKE2b-256 a6abfb8cdb4e729579580f62bc6373caa92735616b79f36b0d334f0ef242eb19

See more details on using hashes here.

File details

Details for the file unreflectanything-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for unreflectanything-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 fee55d8f07965fadfed43e76a64d94b31c4c96cc5959ebb1c8c6849d60ce2358
MD5 ff032762ea18482253daabca4dd58176
BLAKE2b-256 af6cc88985aacb7641a144ea50bbe4cafa74f49a511ab8be05cbefd65dff17e5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page