Python library implementing linear operators to allow solving large-scale optimization problems
A Linear Operator Library for Python
PyLops is an open-source Python library focused on providing a backend-agnostic, idiomatic, matrix-free library of linear operators and related computations. It is inspired by the iconic MATLAB Spot – A Linear-Operator Toolbox project.
To get the most out of PyLops straight out of the box, we recommend
conda to install PyLops:
conda install -c conda-forge pylops
You can also install with
pip install pylops
See the docs (Installation) for more information about dependencies and performance.
Linear operators and inverse problems are at the core of many of the most used algorithms in signal processing, image processing, and remote sensing. For small-scale problems, matrices can be explicitly computed and manipulated with Python numerical scientific libraries such as NumPy and SciPy.
On the other hand, large-scale problems often feature matrices that are prohibitive in size—but whose operations can be described by simple functions. PyLops exploits this to represent linear operators not as array of numbers, but by functions which describe matrix-vector products.
Indeed, many iterative methods (e.g. cg, lsqr) were designed to not rely on the elements of the matrix, only on the result of matrix-vector products. PyLops offers many linear operators (derivatives, convolutions, FFTs and manyh more) as well as solvers for a variety of problems (e.g., least-squares and sparse inversion). With these two ingredients, PyLops can describe and solve a variety of linear inverse problems which appear in many different areas.
Example: A finite-difference operator
A first-order, central finite-difference derivative operator denoted D can be described either as a matrix (array of numbers), or as weighed stencil summation:
import numpy as np # Setup nx = 7 x = np.arange(nx) - (nx-1)/2 # Matrix D_mat = 0.5 * (np.diag(np.ones(nx-1), k=1) - np.diag(np.ones(nx-1), k=-1)) D_mat = D_mat[-1] = 0 # remove edge effects # Function: Stencil summation def central_diff(x): y = np.zeros_like(x) y[1:-1] = 0.5 * (x[2:] - x[:-2]) return y # y = Dx y = D_mat @ x y_fun = central_diff(x) print(np.allclose(y, y_fun)) # True
The matrix formulation can easily be paired with a SciPy least-squares solver to approximately invert the matrix, but this requires us to have an explicit representation for D (in this case,
from scipy.linalg import lstsq # xinv = D^-1 y xinv = lstsq(D_mat, y)
Relying on the functional approach, PyLops wraps a function similar to
central_diff into the
FirstDerivative operator, defining not only the forward mode (Dx) but also the transpose mode (Dᵀy).
In fact, it goes even further as the forward slash operator applies least-squares inversion!
from pylops import FirstDerivative D_op = FirstDerivative(nx, dtype='float64') # y = Dx y = D_op @ x # xinv = D^-1 y xinv_op = D_op / y print(np.allclose(xinv, xinv_op)) # True
Note how the code becomes even more compact and expressive than in the previous case letting the user focus on the formulation of equations of the forward problem to be solved by inversion. PyLops offers many other linear operators, as well as the ability to implement your own in a way that seamlessly interfaces with the rest of the ecosystem.
Feel like contributing to the project? Adding new operators or tutorial?
Follow the instructions detailed in the CONTRIBUTING file before getting started.
The official documentation of PyLops is available here.
Visit this page to get started learning about different operators and their applications as well as how to
create new operators yourself and make it to the
PyLops was initially written by Equinor. It is a flexible and scalable python library for large-scale optimization with linear operators that can be tailored to our needs, and as contribution to the free software community. Since June 2021, PyLops is a NUMFOCUS Affiliated Project.
When using PyLops in scientific publications, please cite the following paper:
- Ravasi, M., and I. Vasconcelos, 2020, PyLops—A linear-operator Python library for scalable algebra and optimization, SoftwareX, 11, 100361. doi: 10.1016/j.softx.2019.100361 (link)
A list of video tutorials to learn more about PyLops:
- Transform 2022: Youtube video links.
- Transform 2021: Youtube video links.
- Swung Rendezvous 2021: Youtube video links.
- PyDataGlobal 2020: Youtube video links.
- Matteo Ravasi, mrava87
- Carlos da Costa, cako
- Dieter Werthmüller, prisae
- Tristan van Leeuwen, TristanvanLeeuwen
- Leonardo Uieda, leouieda
- Filippo Broggini, filippo82
- Tyler Hughes, twhughes
- Lyubov Skopintseva, lskopintseva
- Francesco Picetti, fpicetti
- Alan Richardson, ar4
- BurningKarl, BurningKarl
- Nick Luiken, NickLuiken
- BurningKarl, BurningKarl
- Muhammad Izzatullah, izzatum
- Juan Daniel Romero, jdromerom
- Aniket Singh Rawat, dikwickley
- Rohan Babbar, rohanbabbar04
- Wei Zhang, ZhangWeiGeo
- Fedor Goncharov, fedor-goncharov
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.