Skip to main content

Python library implementing linear operators to allow solving large-scale optimization problems

Project description

PyLops

NUMFOCUS PyPI version Anaconda-Server Badge AzureDevOps Status GithubAction Status Documentation Status Codacy Badge Codacy Badge OS-support Slack Status PyPI downloads Conda downloads

A Linear Operator Library for Python

PyLops is an open-source Python library focused on providing a backend-agnostic, idiomatic, matrix-free library of linear operators and related computations. It is inspired by the iconic MATLAB Spot – A Linear-Operator Toolbox project.

Installation

To get the most out of PyLops straight out of the box, we recommend conda to install PyLops:

conda install -c conda-forge pylops

You can also install with pip:

pip install pylops

See the docs (Installation) for more information about dependencies and performance.

Why PyLops?

Linear operators and inverse problems are at the core of many of the most used algorithms in signal processing, image processing, and remote sensing. For small-scale problems, matrices can be explicitly computed and manipulated with Python numerical scientific libraries such as NumPy and SciPy.

On the other hand, large-scale problems often feature matrices that are prohibitive in size—but whose operations can be described by simple functions. PyLops exploits this to represent linear operators not as array of numbers, but by functions which describe matrix-vector products.

Indeed, many iterative methods (e.g. cg, lsqr) were designed to not rely on the elements of the matrix, only on the result of matrix-vector products. PyLops offers many linear operators (derivatives, convolutions, FFTs and manyh more) as well as solvers for a variety of problems (e.g., least-squares and sparse inversion). With these two ingredients, PyLops can describe and solve a variety of linear inverse problems which appear in many different areas.

Example: A finite-difference operator

A first-order, central finite-difference derivative operator denoted D can be described either as a matrix (array of numbers), or as weighed stencil summation:

import numpy as np

# Setup
nx = 7
x = np.arange(nx) - (nx-1)/2

# Matrix
D_mat = 0.5 * (np.diag(np.ones(nx-1), k=1) - np.diag(np.ones(nx-1), k=-1))
D_mat[0] = D_mat[-1] = 0 # remove edge effects

# Function: Stencil summation
def central_diff(x):
    y = np.zeros_like(x)
    y[1:-1] = 0.5 * (x[2:] - x[:-2])
    return y

# y = Dx
y = D_mat @ x
y_fun = central_diff(x)
print(np.allclose(y, y_fun)) # True

The matrix formulation can easily be paired with a SciPy least-squares solver to approximately invert the matrix, but this requires us to have an explicit representation for D (in this case, D_mat):

from scipy.linalg import lstsq

# xinv = D^-1 y
xinv = lstsq(D_mat, y)[0]

Relying on the functional approach, PyLops wraps a function similar to central_diff into the FirstDerivative operator, defining not only the forward mode (Dx) but also the transpose mode (Dᵀy). In fact, it goes even further as the forward slash operator applies least-squares inversion!

from pylops import FirstDerivative

D_op = FirstDerivative(nx, dtype='float64')

# y = Dx
y = D_op @ x
# xinv = D^-1 y
xinv_op = D_op / y

print(np.allclose(xinv, xinv_op)) # True

Note how the code becomes even more compact and expressive than in the previous case letting the user focus on the formulation of equations of the forward problem to be solved by inversion. PyLops offers many other linear operators, as well as the ability to implement your own in a way that seamlessly interfaces with the rest of the ecosystem.

Contributing

Feel like contributing to the project? Adding new operators or tutorial?

Follow the instructions detailed in the CONTRIBUTING file before getting started.

Documentation

The official documentation of PyLops is available here.

Visit this page to get started learning about different operators and their applications as well as how to create new operators yourself and make it to the Contributors list.

History

PyLops was initially written by Equinor. It is a flexible and scalable python library for large-scale optimization with linear operators that can be tailored to our needs, and as contribution to the free software community. Since June 2021, PyLops is a NUMFOCUS Affiliated Project.

Citing

When using PyLops in scientific publications, please cite the following paper:

  • Ravasi, M., and I. Vasconcelos, 2020, PyLops—A linear-operator Python library for scalable algebra and optimization, SoftwareX, 11, 100361. doi: 10.1016/j.softx.2019.100361 (link)

Tutorials

A list of video tutorials to learn more about PyLops:

  • Transform 2022: Youtube video links.
  • Transform 2021: Youtube video links.
  • Swung Rendezvous 2021: Youtube video links.
  • PyDataGlobal 2020: Youtube video links.

Contributors

  • Matteo Ravasi, mrava87
  • Carlos da Costa, cako
  • Dieter Werthmüller, prisae
  • Tristan van Leeuwen, TristanvanLeeuwen
  • Leonardo Uieda, leouieda
  • Filippo Broggini, filippo82
  • Tyler Hughes, twhughes
  • Lyubov Skopintseva, lskopintseva
  • Francesco Picetti, fpicetti
  • Alan Richardson, ar4
  • BurningKarl, BurningKarl
  • Nick Luiken, NickLuiken
  • BurningKarl, BurningKarl
  • Muhammad Izzatullah, izzatum
  • Juan Daniel Romero, jdromerom
  • Aniket Singh Rawat, dikwickley
  • Rohan Babbar, rohanbabbar04
  • Wei Zhang, ZhangWeiGeo
  • Fedor Goncharov, fedor-goncharov
  • Alex Rakowski, alex-rakowski
  • David Sollberger, solldavid
  • Gustavo Coelho, guaacoelho

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pylops-2.5.0.tar.gz (246.9 kB view details)

Uploaded Source

Built Distribution

pylops-2.5.0-py3-none-any.whl (320.7 kB view details)

Uploaded Python 3

File details

Details for the file pylops-2.5.0.tar.gz.

File metadata

  • Download URL: pylops-2.5.0.tar.gz
  • Upload date:
  • Size: 246.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pylops-2.5.0.tar.gz
Algorithm Hash digest
SHA256 cc56e084504ed8224b67a09782b595fbd5fb5862974df58a5118b458a411251e
MD5 fc2e88ae923efd24a9f0a1ddea3b08a8
BLAKE2b-256 3938f9a3b55eb951a68666f67312fa6438939b0a57e2e05040fa7000cdaee6e0

See more details on using hashes here.

File details

Details for the file pylops-2.5.0-py3-none-any.whl.

File metadata

  • Download URL: pylops-2.5.0-py3-none-any.whl
  • Upload date:
  • Size: 320.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for pylops-2.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8efab24bfd1fe22f8c718aa5fa137f5baf1d019ba719554cfdf7cf89ce8a0657
MD5 c3710df3462ea8d9eb7c95a15df00a9f
BLAKE2b-256 a5c32df3de05611def2f818a55cd58d97466277366c9973e0d139a18de40e0f2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page