Skip to main content

CUDA kernels for FastVideo

Project description

FastVideo Kernel

CUDA kernels for FastVideo video generation.

Installation

git submodule update --init --recursive
cd csrc/fastvideo_kernel
pip install .

Usage

from fastvideo_kernel import sliding_tile_attention, video_sparse_attn, moba_attn_varlen

# Example: Sliding Tile Attention
out = sliding_tile_attention(q, k, v, window_sizes, text_len)

# Example: Video Sparse Attention (with Triton fallback)
out = video_sparse_attn(q, k, v, block_sizes, topk=5)

# Example: VMoBA
out = moba_attn_varlen(q, k, v, cu_seqlens_q, cu_seqlens_k, ...)

Requirements

  • H100 GPU (sm_90a) for CUDA kernels
  • Triton for non-H100 fallback

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fastvideo_kernel-0.1.0.tar.gz (38.1 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

fastvideo_kernel-0.1.0-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

fastvideo_kernel-0.1.0-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

fastvideo_kernel-0.1.0-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

File details

Details for the file fastvideo_kernel-0.1.0.tar.gz.

File metadata

  • Download URL: fastvideo_kernel-0.1.0.tar.gz
  • Upload date:
  • Size: 38.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for fastvideo_kernel-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1087ff788c8ddb82338128c89d9af763dbca8391fdaf75e5a58e00b6f8b3aa2c
MD5 826f5c49e162fa31560246d931bac863
BLAKE2b-256 50988d48b52f9b6c6311507f9cbe1a486f3b12b61bd4d4d66e4d59c3b7c5c17c

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.1.0.tar.gz:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.1.0-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.1.0-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 c0de05220d2b5626361f07015b0ade60f616f4b1ece8a34f996ef27f04af3caa
MD5 85d77d7dc33cf98e381d3f8dd098670a
BLAKE2b-256 78fffd78fcaf4929f9b308c64af1442b8abd74eccecf8fcc05ae19b3ac219394

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.1.0-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.1.0-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.1.0-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 d2b97a8ac78a43210e0bfa4a7c2d0b96dfc0a13b3122ee72be6b06130ba6c56c
MD5 133055eddad113edef7043615c56ba5b
BLAKE2b-256 40abe200a599f805a534220954a42cb3fec5196cd46064c85e31adf3c403d34f

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.1.0-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.1.0-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.1.0-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 56d6ceae96d7f2a8f6083241cfac4631fcfede1714cc4bdbbadab53f2f373f82
MD5 f184e4544e58c2d06f5a24dc77acbbb6
BLAKE2b-256 f9f101876794ae85bbccc3e886343edea727e55b0a926e8b74daca491ecc7753

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.1.0-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page