Skip to main content

Python library implementing linear operators to allow solving large-scale optimization problems

Project description

PyLops

NUMFOCUS PyPI version Anaconda-Server Badge AzureDevOps Status GithubAction Status Documentation Status Codacy Badge Codacy Badge OS-support Slack Status PyPI downloads Conda downloads

A Linear Operator Library for Python

PyLops is an open-source Python library focused on providing a backend-agnostic, idiomatic, matrix-free library of linear operators and related computations. It is inspired by the iconic MATLAB Spot – A Linear-Operator Toolbox project.

Installation

To get the most out of PyLops straight out of the box, we recommend conda to install PyLops:

conda install -c conda-forge pylops

You can also install with pip:

pip install pylops

See the docs (Installation) for more information about dependencies and performance.

Why PyLops?

Linear operators and inverse problems are at the core of many of the most used algorithms in signal processing, image processing, and remote sensing. For small-scale problems, matrices can be explicitly computed and manipulated with Python numerical scientific libraries such as NumPy and SciPy.

On the other hand, large-scale problems often feature matrices that are prohibitive in size—but whose operations can be described by simple functions. PyLops exploits this to represent linear operators not as array of numbers, but by functions which describe matrix-vector products.

Indeed, many iterative methods (e.g. cg, lsqr) were designed to not rely on the elements of the matrix, only on the result of matrix-vector products. PyLops offers many linear operators (derivatives, convolutions, FFTs and manyh more) as well as solvers for a variety of problems (e.g., least-squares and sparse inversion). With these two ingredients, PyLops can describe and solve a variety of linear inverse problems which appear in many different areas.

Example: A finite-difference operator

A first-order, central finite-difference derivative operator denoted D can be described either as a matrix (array of numbers), or as weighed stencil summation:

import numpy as np

# Setup
nx = 7
x = np.arange(nx) - (nx-1)/2

# Matrix
D_mat = 0.5 * (np.diag(np.ones(nx-1), k=1) - np.diag(np.ones(nx-1), k=-1))
D_mat[0] = D_mat[-1] = 0 # remove edge effects

# Function: Stencil summation
def central_diff(x):
    y = np.zeros_like(x)
    y[1:-1] = 0.5 * (x[2:] - x[:-2])
    return y

# y = Dx
y = D_mat @ x
y_fun = central_diff(x)
print(np.allclose(y, y_fun)) # True

The matrix formulation can easily be paired with a SciPy least-squares solver to approximately invert the matrix, but this requires us to have an explicit representation for D (in this case, D_mat):

from scipy.linalg import lstsq

# xinv = D^-1 y
xinv = lstsq(D_mat, y)[0]

Relying on the functional approach, PyLops wraps a function similar to central_diff into the FirstDerivative operator, defining not only the forward mode (Dx) but also the transpose mode (Dᵀy). In fact, it goes even further as the forward slash operator applies least-squares inversion!

from pylops import FirstDerivative

D_op = FirstDerivative(nx, dtype='float64')

# y = Dx
y = D_op @ x
# xinv = D^-1 y
xinv_op = D_op / y

print(np.allclose(xinv, xinv_op)) # True

Note how the code becomes even more compact and expressive than in the previous case letting the user focus on the formulation of equations of the forward problem to be solved by inversion. PyLops offers many other linear operators, as well as the ability to implement your own in a way that seamlessly interfaces with the rest of the ecosystem.

Contributing

Feel like contributing to the project? Adding new operators or tutorial?

Follow the instructions detailed in the CONTRIBUTING file before getting started.

Documentation

The official documentation of PyLops is available here.

Visit this page to get started learning about different operators and their applications as well as how to create new operators yourself and make it to the Contributors list.

History

PyLops was initially written by Equinor. It is a flexible and scalable python library for large-scale optimization with linear operators that can be tailored to our needs, and as contribution to the free software community. Since June 2021, PyLops is a NUMFOCUS Affiliated Project.

Citing

When using PyLops in scientific publications, please cite the following paper:

  • Ravasi, M., and I. Vasconcelos, 2020, PyLops—A linear-operator Python library for scalable algebra and optimization, SoftwareX, 11, 100361. doi: 10.1016/j.softx.2019.100361 (link)

Tutorials

A list of video tutorials to learn more about PyLops:

  • Transform 2022: Youtube video links.
  • Transform 2021: Youtube video links.
  • Swung Rendezvous 2021: Youtube video links.
  • PyDataGlobal 2020: Youtube video links.

Contributors

  • Matteo Ravasi, mrava87
  • Carlos da Costa, cako
  • Dieter Werthmüller, prisae
  • Tristan van Leeuwen, TristanvanLeeuwen
  • Leonardo Uieda, leouieda
  • Filippo Broggini, filippo82
  • Tyler Hughes, twhughes
  • Lyubov Skopintseva, lskopintseva
  • Francesco Picetti, fpicetti
  • Alan Richardson, ar4
  • BurningKarl, BurningKarl
  • Nick Luiken, NickLuiken
  • BurningKarl, BurningKarl
  • Muhammad Izzatullah, izzatum
  • Juan Daniel Romero, jdromerom
  • Aniket Singh Rawat, dikwickley
  • Rohan Babbar, rohanbabbar04
  • Wei Zhang, ZhangWeiGeo
  • Fedor Goncharov, fedor-goncharov
  • Alex Rakowski, alex-rakowski
  • David Sollberger, solldavid
  • Gustavo Coelho, guaacoelho

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pylops-2.3.1.tar.gz (236.2 kB view details)

Uploaded Source

Built Distribution

pylops-2.3.1-py3-none-any.whl (304.6 kB view details)

Uploaded Python 3

File details

Details for the file pylops-2.3.1.tar.gz.

File metadata

  • Download URL: pylops-2.3.1.tar.gz
  • Upload date:
  • Size: 236.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.5

File hashes

Hashes for pylops-2.3.1.tar.gz
Algorithm Hash digest
SHA256 9f44040d5cb6e3e9e781da1991ca4e7e9f5a29de0ed3bb5a3ea0da35aa2b5273
MD5 0cb0b2205c5b29dfe41c15437a9d4ca2
BLAKE2b-256 986a67d85a21720b185145d26c4abba26312854f65839aae5a13cc5f6d5e1cc8

See more details on using hashes here.

Provenance

File details

Details for the file pylops-2.3.1-py3-none-any.whl.

File metadata

  • Download URL: pylops-2.3.1-py3-none-any.whl
  • Upload date:
  • Size: 304.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.0 CPython/3.12.5

File hashes

Hashes for pylops-2.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 46d2265f9e703abcc8b6605f85bb44bca233994f93492bd2ab7a20ea32213bdf
MD5 501e37095e67286ead4fe7c521d291b2
BLAKE2b-256 970b7badb4376ecf87ea987cc704113a49e9b46269fa763d0488a7407f88a5d1

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page