Skip to main content

Class Activation Map generation for nnUNet v2 models

Project description

nnunetv2_cam PyPI Downloads PyPI - Version

Class Activation Map (CAM) Generation for nnUNet v2 Models

A standalone, external Python module for computing Class Activation Maps (CAMs) on models trained with nnUNetv2. This module does not modify nnUNetv2 source code and uses it as a dependency.

if you find this tool useful, please consider citing:

@misc{abuzeid2025xaidrivendiagnosisgeneralizationfailure,
      title={XAI-Driven Diagnosis of Generalization Failure in State-Space Cerebrovascular Segmentation Models: A Case Study on Domain Shift Between RSNA and TopCoW Datasets}, 
      author={Youssef Abuzeid and Shimaa El-Bana and Ahmad Al-Kabbany},
      year={2025},
      eprint={2512.13977},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2512.13977}, 
}

📑 Table of Contents


Features

  • Zero nnUNetv2 Modifications: Works as an external library
  • Leverages Official Pipeline: Uses nnUNetv2's preprocessing, inference, and postprocessing
  • Sliding Window Support: Full support for nnUNet's patch-based inference
  • CAM Methods: GradCAM, GradCAM++, HiResCAM, EigenCAM, LayerCAM, and more (see Supported CAM Methods)
  • 2D and 3D Support: Works with both 2D and 3D medical images
  • Ensemble Predictions: Supports multi-fold ensemble inference
  • CLI and Python API: Use from command line or integrate into your code

Installation

Prerequisites

  • Python >= 3.9
  • PyTorch >= 2.0.0
  • nnUNetv2 >= 2.0
  • pytorch-grad-cam >= 1.4.0

Install via pip

pip install nnunetv2-cam

Installation Steps from Source

git clone https://github.com/Yousif-Abuzeid/nnunetv2-CAM.git
cd nnunetv2_CAM
pip install -e .
pip show nnunetv2_CAM
# Cell 1: Install
!cd /content/nnunetv2_cam && pip install -e .

# Cell 2: RESTART RUNTIME
# Go to: Runtime → Restart runtime

# Cell 3: Test (after restart)
from nnunetv2_cam import run_cam_for_prediction
print("✅ Installation successful!")

Supported CAM Methods

This package supports all CAM methods from pytorch-grad-cam:

Basic Methods

  • GradCAM: Weight 2D activations by average gradient Recommended for most cases
  • HiResCAM: Like GradCAM but element-wise multiply activations with gradients (more faithful)
  • GradCAMElementWise: Like GradCAM but element-wise multiply before summing
  • GradCAM++: Uses second-order gradients for better localization
  • XGradCAM: Scale gradients by normalized activations

Perturbation-Based Methods

  • AblationCAM: Zero out activations and measure output drop (includes batched implementation)

Eigen-Based Methods

  • EigenCAM: First principle component of 2D activations (no class discrimination)
  • EigenGradCAM: Like EigenCAM but with class discrimination (cleaner than GradCAM)

Advanced Methods

  • LayerCAM: Spatially weight activations by positive gradients (better for lower layers)
  • FullGrad: Compute gradients of biases from all over the network
  • FinerCAM: Improves fine-grained classification by comparing similar classes
  • KPCA-GradCAM: Like EigenCAM but with Kernel PCA instead of PCA
  • FEM: Gradient-free method that binarizes activations
  • ShapleyCAM: Weight activations using gradient and Hessian-vector product

3D Compatibility

All gradient-based methods support both 2D and 3D medical imaging:

  • gradcam, hirescam, gradcamelementwise
  • gradcam++, xgradcam (custom 3D-compatible implementations)
  • eigencam, eigengradcam, layercam
  • ablationcam, fullgrad

Note: For 3D volumes, use cam_type='3d' to process the entire volume at once. For 2D slice-by-slice processing, use cam_type='2d'.

List Available Methods

Python API:

from nnunetv2_cam.cam_core import get_available_cam_methods
print(get_available_cam_methods())

Command Line:

nnunetv2_cam --list-methods

💡 Quick Recommendations:

  • Start with: gradcam - Fast and reliable (3D ✅)
  • Better localization: gradcam++ or hirescam (3D ✅)
  • Cleaner results: eigengradcam (3D ✅)
  • Lower layers: layercam (3D ✅)

Quick Start

Python API

from nnunetv2.inference.predict_from_raw_data import nnUNetPredictor
from nnunetv2_cam import run_cam_for_prediction
import torch

# Initialize nnUNet predictor
predictor = nnUNetPredictor(device=torch.device('cuda'))
predictor.initialize_from_trained_model_folder(
    '/path/to/trained/model',
    use_folds=(0,),  # Use single fold for faster processing
    checkpoint_name='checkpoint_final.pth'
)

# Generate CAMs
heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files='/path/to/input/image_0000.nii.gz',
    output_folder='/path/to/output',
    target_layer='encoder.stages.4.0',  # MUST specify!
    target_class=1,
    method='gradcam',
    cam_type='2d',
    verbose=True
)

print(f"Generated {len(heatmaps)} heatmaps")

Command Line

nnunetv2_cam \
    -i /path/to/input/images \
    -o /path/to/output \
    -m /path/to/trained/model \
    -f 0 \
    --target-layer encoder.stages.4.0 \
    --target-class 1 \
    --verbose

Usage Examples

Example 1: Complete Google Colab Workflow

# After installation and restart!

from nnunetv2.inference.predict_from_raw_data import nnUNetPredictor
from nnunetv2_cam import run_cam_for_prediction
import torch
import os

# Setup paths
MODEL = "/content/data/nnUNet_results/Dataset997/nnUNetTrainer__nnUNetPlans__3d_fullres"
INPUT = "/content/data/nnUNet_raw/Dataset997/imagesTs/"
OUTPUT = "/content/output_cams"
os.makedirs(OUTPUT, exist_ok=True)

# Initialize predictor
device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')
predictor = nnUNetPredictor(device=device, verbose=True)
predictor.initialize_from_trained_model_folder(MODEL, use_folds=(0,))

# Generate CAMs
heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files=INPUT,
    output_folder=OUTPUT,
    target_layer='encoder.stages.4.0',
    target_class=1,
    verbose=True
)

print(f"✅ Generated {len(heatmaps)} CAMs")

Example 2: Using GradCAM++

heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files='/path/to/images',
    output_folder='/path/to/output',
    target_layer='encoder.stages.4.0',
    target_class=1,
    method='gradcam++',  # Use GradCAM++ instead
    cam_type='2d',
    verbose=True
)

Example 3: 3D CAM with Custom Layer

heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files='/path/to/images',
    output_folder='/path/to/output',
    target_layer='decoder.stages.0.0',  # Decoder layer
    target_class=2,  # Different class
    method='gradcam',
    cam_type='3d',  # 3D CAM
    verbose=True
)

Example 4: Processing Multiple Files

# Process specific files
file_list = [
    '/data/case001_0000.nii.gz',
    '/data/case002_0000.nii.gz',
    '/data/case003_0000.nii.gz',
]

heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files=file_list,
    output_folder='/output',
    target_layer='encoder.stages.4.0',
    target_class=1,
    verbose=True
)

# Analyze results
for i, (file, heatmap) in enumerate(zip(file_list, heatmaps)):
    print(f"File: {file}")
    print(f"  Shape: {heatmap.shape}")
    print(f"  Min: {heatmap.min():.3f}, Max: {heatmap.max():.3f}")
    print(f"  Mean: {heatmap.mean():.3f}")

Finding Target Layers

Method 1: List Layers in Python

from nnunetv2.inference.predict_from_raw_data import nnUNetPredictor
import torch

predictor = nnUNetPredictor(device=torch.device('cuda'))
predictor.initialize_from_trained_model_folder('/path/to/model', use_folds=(0,))

# Print first 30 layers
print("Available layers:")
for i, (name, _) in enumerate(predictor.network.named_modules(), 1):
    if name:
        print(f"{i:3d}. {name}")
        if i >= 30:
            break

Method 2: Use CLI

nnunetv2_cam --list-layers \
    -m /path/to/model \
    -i /dummy -o /dummy --target-layer dummy

Target Layer

For standard nnU-Net architectures:

Seg Grad Cam proposed using the bottleneck layer of the encoder but more recent layers propose that segmentation is different from classification and the decision isnt taken in one layer only so You could use multiple layers to get a better result or if you want you can stick to one layer like this:

# Option 1: Single Layer (Bottleneck)
target_layer = 'encoder.stages.4.0'

# Option 2: Multi-Layer Aggregation
target_layers = [
    'encoder.stages.4.0',
    'decoder.stages.0.0',
    'decoder.stages.1.0',
    'decoder.stages.2.0'
]

heatmaps = run_cam_for_prediction(
    predictor=predictor,
    input_files='/path/to/images',
    output_folder='/path/to/output',
    target_layer=target_layers,
    target_class=1,
    verbose=True
)
Layer Name Description
encoder.stages.4.0 Deepest encoder layer (Bottleneck)
decoder.stages.0.0 First decoder stage
decoder.stages.1.0 Second decoder stage
decoder.stages.2.0 Third decoder stage

Output Format

The tool generates two types of outputs:

1. Slice Visualizations (PNG)

  • Location: {output_folder}/cam/{case_name}/{case_name}_{slice_idx}.png
  • Format: Jet colormap overlaid on grayscale image
  • Example: output/cam/case001/case001_050.png

2. Heatmap Arrays (NumPy)

  • Returned by run_cam_for_prediction() as a list
  • Each element is a NumPy array with shape matching preprocessed input
  • Values normalized to [0, 1] range
  • Can be saved for further analysis
# Save heatmap to file
import numpy as np
np.save('/output/case001_cam.npy', heatmaps)

# Load later
loaded_cam = np.load('/output/case001_cam.npy')

CLI Reference

Required Arguments

  • -i, --input: Input folder or file path
  • -o, --output: Output folder for CAM visualizations
  • -m, --model: Path to trained nnUNet model folder
  • --target-layer: Name of layer to compute CAM for

Optional Arguments

Argument Default Description
-f, --folds 0 1 2 3 4 Folds to use for ensemble
-chk, --checkpoint checkpoint_final.pth Checkpoint filename
--target-class 1 Target class index
--method gradcam CAM method (use --list-methods to see all)
--cam-type 2d CAM type (2d/3d)
--disable-tta False Disable test-time augmentation
-step_size 0.5 Sliding window step size
-device cuda Device (cuda/cpu/mps)
--verbose False Print detailed progress
--list-layers False List available layers and exit
--no-save-slices False Don't save PNG slices
--save-numpy False Save CAM heatmaps as .npy files
--pool-size None Pooling size for Seg-XRes-CAM
--pool-mode max Pooling mode for Seg-XRes-CAM (max/mean)

Examples

Basic usage:

nnunetv2_cam -i /data/images -o /output -m /model --target-layer encoder.stages.4.0

Single fold, verbose:

nnunetv2_cam -i /data/images -o /output -m /model -f 0 --target-layer encoder.stages.4.0 --verbose

GradCAM++ with 3D:

nnunetv2_cam -i /data/images -o /output -m /model --target-layer encoder.stages.4.0 --method gradcam++ --cam-type 3d

List layers:

nnunetv2_cam -m /model --list-layers -i /dummy -o /dummy --target-layer dummy

Architecture

nnunetv2_cam/
├── __init__.py          # Package initialization
├── api.py               # Main programmatic interface
├── cam_core.py          # CAM computation logic
├── cli.py               # Command-line interface
├── utils.py             # Helper functions

How It Works

  1. Initialization: Receives initialized nnUNetPredictor instance
  2. Preprocessing: Uses nnUNet's preprocessing_iterator_fromfiles for identical preprocessing
  3. Sliding Window: Replicates nnUNet's sliding window logic
  4. CAM Computation: For each patch:
    • Generates prediction using nnUNet inference
    • Computes CAM using pytorch-grad-cam
    • Accumulates across overlapping patches
  5. Postprocessing: Normalizes and saves visualizations

License

Apache License 2.0


Contributing

Contributions are welcome! Please open an issue or pull request.


Acknowledgments

  • nnUNet Team: For the excellent nnUNet framework
  • pytorch-grad-cam: For the CAM implementation library
  • Reference: Based on insights from MoriiHuang's nnUNet-UAMT-DA-GRADCAM

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nnunetv2_cam-0.1.6.1.tar.gz (27.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nnunetv2_cam-0.1.6.1-py3-none-any.whl (28.0 kB view details)

Uploaded Python 3

File details

Details for the file nnunetv2_cam-0.1.6.1.tar.gz.

File metadata

  • Download URL: nnunetv2_cam-0.1.6.1.tar.gz
  • Upload date:
  • Size: 27.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for nnunetv2_cam-0.1.6.1.tar.gz
Algorithm Hash digest
SHA256 2c1b8b7b088d5ab3fb152ef78165166e5d4c130ec8d394171c406c8f5b3a345e
MD5 2323c6a372169756a5e7c697f90fad73
BLAKE2b-256 e85caae1e13960e524d9da7d9b84708cfcc1680dfac4a17d1ed0fe85c96535d4

See more details on using hashes here.

File details

Details for the file nnunetv2_cam-0.1.6.1-py3-none-any.whl.

File metadata

  • Download URL: nnunetv2_cam-0.1.6.1-py3-none-any.whl
  • Upload date:
  • Size: 28.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for nnunetv2_cam-0.1.6.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3bb180e5b9ab2c915aa4269c12dfc1186df3025f80f2d3692a8453af2dd5b13a
MD5 a087ff9258e5c933cc2bbe568b887ba0
BLAKE2b-256 734e19daf50d892a7ce2aa0c26c35afb7ecee0845423310e28a50c567c21229c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page