Skip to main content

Unified CUDA kernels for FastVideo

Project description

FastVideo Kernel

CUDA kernels for FastVideo video generation.

Installation

git submodule update --init --recursive
cd fastvideo-kernel
pip install .

Usage

from fastvideo_kernel import sliding_tile_attention, video_sparse_attn, moba_attn_varlen

# Example: Sliding Tile Attention
out = sliding_tile_attention(q, k, v, window_sizes, text_len)

# Example: Video Sparse Attention (with Triton fallback)
out = video_sparse_attn(q, k, v, block_sizes, topk=5)

# Example: VMoBA
out = moba_attn_varlen(q, k, v, cu_seqlens_q, cu_seqlens_k, ...)

Requirements

  • H100 GPU (sm_90a) for CUDA kernels
  • Triton for non-H100 fallback

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fastvideo_kernel-0.2.1.tar.gz (3.9 MB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

fastvideo_kernel-0.2.1-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

fastvideo_kernel-0.2.1-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

fastvideo_kernel-0.2.1-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl (1.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.34+ x86-64manylinux: glibc 2.35+ x86-64

File details

Details for the file fastvideo_kernel-0.2.1.tar.gz.

File metadata

  • Download URL: fastvideo_kernel-0.2.1.tar.gz
  • Upload date:
  • Size: 3.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for fastvideo_kernel-0.2.1.tar.gz
Algorithm Hash digest
SHA256 48df047d9e1fb22d7fd1f0152847ef2bcadfe6e641bcbacb97d331e2c45e7421
MD5 acba68ca7a3e8ded8690544cfda69369
BLAKE2b-256 b05f1097e7e466e4141eb506f8c364e27f269b1068dce32d52c6face321ba172

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.2.1.tar.gz:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.2.1-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.2.1-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 5693f3986161c4642f76a08f949e085b8cc2f341b340345cd855cc167a3d988c
MD5 0392fe48e28bd458d8f460179f5d4c4c
BLAKE2b-256 18c9610faba3eafa01d933ef25993bb50a9d8263633f8d265ff0fa304e597c96

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.2.1-cp312-cp312-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.2.1-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.2.1-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 d36cae2b12f034dc49349c3689309ba52f12c12bb9cea7cfd1123813aa50ddd7
MD5 d5ec9eb66ee4f51b7cf44bd3babd4efd
BLAKE2b-256 459835bbd888c46d0b41c6b8dec6bba42b52448f91adbdb6d115048b0015ec32

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.2.1-cp311-cp311-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file fastvideo_kernel-0.2.1-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl.

File metadata

File hashes

Hashes for fastvideo_kernel-0.2.1-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl
Algorithm Hash digest
SHA256 3e43b4267a210c707f0762f98e4889557194beae6f8cf6a0002791e8a2ba128c
MD5 452b2fccc00ab979cea830d8dde88c96
BLAKE2b-256 b54c531977acabb5b62205f891685b92a88dcd37a1683bf89eb5c4d2fb4fef61

See more details on using hashes here.

Provenance

The following attestation bundles were made for fastvideo_kernel-0.2.1-cp310-cp310-manylinux_2_34_x86_64.manylinux_2_35_x86_64.whl:

Publisher: fastvideo-kernel-publish.yml on hao-ai-lab/FastVideo

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page