cutensor 1.6.0.3

NVIDIA cuTENSOR

cuTENSOR is a high-performance CUDA library for tensor primitives.

Key Features

• Extensive mixed-precision support:

  • FP64 inputs with FP32 compute.

  • FP32 inputs with FP16, BF16, or TF32 compute.

  • Complex-times-real operations.

  • Conjugate (without transpose) support.

• Support for up to 64-dimensional tensors.

• Arbitrary data layouts.

• Trivially serializable data structures.

• Main computational routines:

  • Direct (i.e., transpose-free) tensor contractions.

  • Tensor reductions (including partial reductions).

  • Element-wise tensor operations:

    • Support for various activation functions.

    • Arbitrary tensor permutations.

    • Conversion between different data types.

Documentation

Please refer to https://docs.nvidia.com/cuda/cutensor/index.html for the cuTENSOR documentation.