Skip to main content

Memory-efficient RF-DETR with RFDETRSegIntermediate and xformers attention support

Project description

RFDETRSegIntermediate

A Memory Efficient RFDETR Model

This is a package I made to allow for a intermediate RFDETR model, one that uses memory efficent xformers package to train and requires significantly less memory. It is called, RFDETRSegIntermediate.

On my local machine, it allowed me to train something that would have taken 16GB into about 8GB of VRAM.

This has 2 fairly different versions of installation. One on Windows and the other on Linux:

Windows Installation:

Run these BEFORE downloading the package:

pip install https://huggingface.co/madbuda/triton-windows-builds/resolve/main/triton-3.0.0-cp312-cp312-win_amd64.whl 
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu128

Then

pip3 install rfdetr-seg-intermediate

Linux Installation:

pip3 install triton
pip3 install -U xformers --index-url https://download.pytorch.org/whl/cu128

Then

pip3 install rfdetr-seg-intermediate

Troubleshooting (how it runs on my local Windows machine):

1- run
pip install https://huggingface.co/madbuda/triton-windows-builds/resolve/main/triton-3.0.0-cp312-cp312-win_amd64.whl 

2- run 
pip install rfdetr-seg-intermediate

3- run
pip install xformers --force-reinstall --index-url https://download.pytorch.org/whl/cu128    

"Why this isnt a 1 click install?"

  • Multiple reasons, but there are a few critical packages here that are not even meant to be run on Windows but have been compiled for Win32 thanks to the awesome internet. There are other packages that are in conflict with eachother if installed by 1 click but will be ok if the steps above are followed. Honestly, the most critical libraries are the Hugging Face version of Triton and xformers with the proper cuda installed. I try to make my libraries as good as they can, but for this specific one becuase of the abnormalities it makes a 1 click install not possible.

Other Notes:

  • Install all packages EXACTLY as the pyproject.toml wants it to be.
  • If for some reason it reinstalls pytorch as the CPU version, install the CUDA version instead if you wish. Just make sure its torch 2.10.0
  • If you're having issues, clone this repo and run pip install -r requirements.txt to install the exact dependency versions tested with this package.

Links:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rfdetr_seg_intermediate-0.3.1.tar.gz (137.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rfdetr_seg_intermediate-0.3.1-py3-none-any.whl (160.6 kB view details)

Uploaded Python 3

File details

Details for the file rfdetr_seg_intermediate-0.3.1.tar.gz.

File metadata

  • Download URL: rfdetr_seg_intermediate-0.3.1.tar.gz
  • Upload date:
  • Size: 137.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.9

File hashes

Hashes for rfdetr_seg_intermediate-0.3.1.tar.gz
Algorithm Hash digest
SHA256 193cbf05c59f1a0c70ebfd9e4d48c643f0e0ad7d676b056eb7c091b5e0ca6100
MD5 326f5029ad3282b83cc8fd0e04037dbb
BLAKE2b-256 05477b685987f1ceba8e7619a233ac92be2d3f091638c1fb73a21c99620d8a9f

See more details on using hashes here.

File details

Details for the file rfdetr_seg_intermediate-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for rfdetr_seg_intermediate-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 4a6366148bc2adc0ab9ca48d6fa20fbcdce3542f532a5cd3cb47344259b165de
MD5 956c9cba99e01659be41efdf82fea794
BLAKE2b-256 cdeff28c983302bf34a33b5294c321c02b418e55aeae18890ae99539402d21e8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page