Skip to main content

Deep Learning with Tensors in Python, using PyTorch and TensorLy.

Project description

https://badge.fury.io/py/tensorly-torch.svg

TensorLy-Torch

TensorLy-Torch is a Python library for deep tensor networks that builds on top of TensorLy and PyTorch. It allows to easily leverage tensor methods in a deep learning setting and comes with all batteries included.

With TensorLy-Torch, you can easily:

  • Tensor Factorizations: decomposing, manipulating and initializing tensor decompositions can be tricky. We take care of it all, in a convenient, unified API.

  • Leverage structure in your data: with tensor layers, you can easily leverage the structure in your data, through Tensor Regression Layers, Factorized Convolutions, etc

  • Built-in tensor layers: all you have to do is import tensorly torch and include the layers we provide directly within your PyTorch models!

  • Tensor hooks: you can easily augment your architectures with our built-in Tensor Hooks. Robustify your network with Tensor Dropout and automatically select the rank end-to-end with L1 Regularization!

  • All the methods available: we are always adding more methods to make it easy to compare between the performance of various deep tensor based methods!

Deep Tensorized Learning

Tensor methods generalize matrix algebraic operations to higher-orders. Deep neural networks typically map between higher-order tensors. In fact, it is the ability of deep convolutional neural networks to preserve and leverage local structure that, along with large datasets and efficient hardware, made the current levels of performance possible. Tensor methods allow to further leverage and preserve that structure, for individual layers or whole networks.

./doc/_static/tensorly-torch-pyramid.png

TensorLy is a Python library that aims at making tensor learning simple and accessible. It provides a high-level API for tensor methods, including core tensor operations, tensor decomposition and regression. It has a flexible backend that allows running operations seamlessly using NumPy, PyTorch, TensorFlow, JAX, MXNet and CuPy.

TensorLy-Torch is a PyTorch only library that builds on top of TensorLy and provides out-of-the-box tensor layers.

Improve your neural networks with tensor methods

Tensor methods generalize matrix algebraic operations to higher-orders. Deep neural networks typically map between higher-order tensors. In fact, it is the ability of deep convolutional neural networks to preserve and leverage local structure that, along with large datasets and efficient hardware, made the current levels of performance possible. Tensor methods allow to further leverage and preserve that structure, for individual layers or whole networks.

In TensorLy-Torch, we provide convenient layers that do all the heavy lifting for you and provide the benefits tensor based layers wrapped in a nice, well documented and tested API.

For instance, convolution layers of any order (2D, 3D or more), can be efficiently parametrized using tensor decomposition. Using a CP decomposition results in a separable convolution and you can replace your original convolution with a series of small efficient ones:

./doc/_static/cp-conv.png

These can be easily perform with FactorizedConv in TensorLy-Torch. We also have Tucker convolutions and new tensor-train convolutions! We also implement various other methods such as tensor regression and contraction layers, tensorized linear layers, tensor dropout and more!

Installing TensorLy-Torch

Through pip

pip install tensorly-torch

From source

git clone https://github.com/tensorly/torch
cd torch
pip install -e .

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tensorly-torch-0.5.0.tar.gz (43.3 kB view details)

Uploaded Source

Built Distribution

tensorly_torch-0.5.0-py3-none-any.whl (59.3 kB view details)

Uploaded Python 3

File details

Details for the file tensorly-torch-0.5.0.tar.gz.

File metadata

  • Download URL: tensorly-torch-0.5.0.tar.gz
  • Upload date:
  • Size: 43.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.9.19

File hashes

Hashes for tensorly-torch-0.5.0.tar.gz
Algorithm Hash digest
SHA256 4c2f19f361113ca78f09b504a786075b0f51425468ae997a5f8018d4be6a4db5
MD5 e29901aeb7ac0f7a859db75091b1590a
BLAKE2b-256 d624afea0adc5c29ae40d28bc359eaf888a1605699fbba690e76ec67c51b055a

See more details on using hashes here.

File details

Details for the file tensorly_torch-0.5.0-py3-none-any.whl.

File metadata

File hashes

Hashes for tensorly_torch-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6a14cab43bb82892e58940fb75e5c55ec1a550d9063fb722469f93cba449940b
MD5 e0811854811848ae5c6d0243b3ebf13d
BLAKE2b-256 fb352da451f342ee532bf66507c89ff3cdefc0dfbacff83a2f088811deb2df17

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page