Skip to main content

an out-of-the-box acceleration library for diffusion models

Project description


Docker image build Run examples

OneDiff is an out-of-the-box acceleration library for diffusion models (especially for ComfyUI, HF diffusers, and Stable Diffusion web UI).

OneDiff is the abbreviation of "one line of code to accelerate diffusion models".

Need help or communicate

Easy to use

State-of-the-art performance

OS and GPU support

  • Linux
    • If you want to use OneDiff on Windows, please use it under WSL.
  • NVIDIA GPUs

OneDiff Online Playground

Online Playground

OneDiff Enterprise Edition

If you need Enterprise-level Support for your system or business, you can

OneDiff Enterprise Edition can be subscripted for one month and one GPU and the cost is low.

  OneDiff Enterprise OneDiff Community
SD/SDXL series model Optimization Yes Yes
UNet/VAE/ControlNet Optimization Yes Yes
LoRA(and dynamic switching LoRA) Yes Yes
SDXL Turbo/LCM Yes Yes
Stable Video Diffusion Yes Yes
HF diffusers Yes Yes
ComfyUI Yes Yes
Stable Diffusion web UI Yes Yes
Multiple Resolutions Yes(No time cost for most of the cases) Yes(No time cost for most of the cases)
More Extreme and Dedicated optimization(usually another 20~100% performance gain) Yes
Technical Support for deployment High priority support Community
Get the latest technology/feature Yes

OneDiff Installation

Install from source

1. Install OneFlow

NOTE: We have updated OneFlow a lot for OneDiff, so please install OneFlow by the links below.

  • CUDA 11.8

    # For NA/EU users
    python3 -m pip install -U --pre oneflow -f https://github.com/siliconflow/oneflow_releases/releases/expanded_assets/community_cu118
    
    # For CN users
    python3 -m pip install --pre oneflow -f https://oneflow-pro.oss-cn-beijing.aliyuncs.com/branch/community/cu118
    
Click to get OneFlow packages for other CUDA versions.
  • CUDA 12.1

    # For NA/EU users
    python3 -m pip install -U --pre oneflow -f https://github.com/siliconflow/oneflow_releases/releases/expanded_assets/community_cu121
    
    # For CN users
    python3 -m pip install --pre oneflow -f https://oneflow-pro.oss-cn-beijing.aliyuncs.com/branch/community/cu121
    
  • CUDA 12.2

    # For NA/EU users
    python3 -m pip install -U --pre oneflow -f https://github.com/siliconflow/oneflow_releases/releases/expanded_assets/community_cu122
    
    # For CN users
    python3 -m pip install --pre oneflow -f https://oneflow-pro.oss-cn-beijing.aliyuncs.com/branch/community/cu122
    

2. Install torch and diffusers

python3 -m pip install "torch" "transformers==4.27.1" "diffusers[torch]==0.19.3"

3. Install OneDiff

  • From PyPI
python3 -m pip install --pre onediff
  • From source
git clone https://github.com/siliconflow/onediff.git
cd onediff && python3 -m pip install -e .

4. (Optional)Login huggingface-cli

python3 -m pip install huggingface_hub
 ~/.local/bin/huggingface-cli login

Release

  • run examples to check it works

    python3 examples/text_to_image.py
    python3 examples/text_to_image_dpmsolver.py
    
  • bump version in these files:

    .github/workflows/pub.yml
    src/onediff/__init__.py
    
  • install build package

    python3 -m pip install build
    
  • build wheel

    rm -rf dist
    python3 -m build
    
  • upload to pypi

    twine upload dist/*
    

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onediff-0.12.1.dev202402010126.tar.gz (72.0 kB view details)

Uploaded Source

Built Distribution

onediff-0.12.1.dev202402010126-py3-none-any.whl (81.5 kB view details)

Uploaded Python 3

File details

Details for the file onediff-0.12.1.dev202402010126.tar.gz.

File metadata

File hashes

Hashes for onediff-0.12.1.dev202402010126.tar.gz
Algorithm Hash digest
SHA256 cc2a36f44de3ccc44ccdbb48281c0eab32c107ab07454d665c8243d2ae3e094d
MD5 98b21bd3ca5632cd81e177c2b8d44b77
BLAKE2b-256 288c20cc6658cbb4fc278c0211ab0c139b4ddccdc1e64b3fdd4d20b5766a1eae

See more details on using hashes here.

File details

Details for the file onediff-0.12.1.dev202402010126-py3-none-any.whl.

File metadata

File hashes

Hashes for onediff-0.12.1.dev202402010126-py3-none-any.whl
Algorithm Hash digest
SHA256 29bdf917e2b7fff0f8e30e23efcd97374faa0b60f3f3954741f661694b31dc52
MD5 336ced77e8eeb7279df21fe1af82874e
BLAKE2b-256 e462b32456b121c18c71b42227c96d77b41aaafc3925ff5b2b914630c71937eb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page