Causal depthwise conv1d in CUDA with a PyTorch interface

Features:

Support fp32, fp16, bf16.
Kernel size 2, 3, 4.

How to use

from causal_conv1d import causal_conv1d_fn

def causal_conv1d_fn(x, weight, bias=None, activation=None):
    """
    x: (batch, dim, seqlen)
    weight: (dim, width)
    bias: (dim,)
    activation: either None or "silu" or "swish"

    out: (batch, dim, seqlen)
    """

Equivalent to:

import torch.nn.functional as F

F.conv1d(x, weight.unsqueeze(1), bias, padding=width - 1, groups=dim)[..., :seqlen]

Additional Prerequisites for AMD cards

Patching ROCm

If you are on ROCm 6.0, run the following steps to avoid errors during compilation. This is not required for ROCm 6.1 onwards.

Locate your ROCm installation directory. This is typically found at /opt/rocm/, but may vary depending on your installation.

Apply the Patch. Run with sudo in case you encounter permission issues.

 patch /opt/rocm/include/hip/amd_detail/amd_hip_bf16.h < rocm_patch/rocm6_0.patch

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

causal_conv1d-1.7.0.tar.gz (30.3 kB view details)

Uploaded Aug 20, 2026 Source

File details

Details for the file causal_conv1d-1.7.0.tar.gz.

File metadata

Download URL: causal_conv1d-1.7.0.tar.gz
Upload date: Aug 20, 2026
Size: 30.3 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/7.0.0 CPython/3.10.21

File hashes

Hashes for causal_conv1d-1.7.0.tar.gz
Algorithm	Hash digest
SHA256	`3202758494eaa7b597ce1c282dfa188889506bfcb92cad3c407d26736bfcd32b`
MD5	`799b58cb982045c5f829c676557154a0`
BLAKE2b-256	`f4d1eba27735f31bd5527d39a3c7f693e6ded7b844cab275db719a15ad37b6cd`