Skip to main content

rocket-fft extends Numba by scipy.fft and numpy.fft

Project description

rocket-fft

Rocket-FFT makes Numba aware of numpy.fft and scipy.fft. Rocket-FFT takes its name from the PocketFFT Fast Fourier Transformation library that powers it, and Numba's goal of making your scientific Python code blazingly fast - like a rocket 🚀.

Rocket-FFT has been tested against both the SciPy and Numpy test suites, plus some additional typing tests. Therefore, it is considered safe to use, but the author still welcomes bug reports to help improve the project.

Getting started

The easiest way to get Rocket-FFT is to:

pip install rocket-fft

Alternatively, you can build it yourself:

git clone https://github.com/styfenschaer/rocket-fft.git
pip install ./rocket-fft

The latter will require a C++ compiler to be installed on your system.

Rocket-FFT uses setuptools entry points to register itself as an extension of Numba, so there is no need for additional imports. Once installed successfully, the following will work:

import numba as nb
import numpy as np

@nb.njit
def jit_fft(x):
    return np.fft.fft(x)

a = np.array([3, 1, 4, 1, 5, 9, 2, 6])
jit_fft(a)

Supported Numpy functions

The whole numpy.fft module is supported, which contains all the functions listed below:

  • numpy.fft.fft
  • numpy.fft.ifft
  • numpy.fft.fft2*
  • numpy.fft.ifft2*
  • numpy.fft.fftn*
  • numpy.fft.ifftn*
  • numpy.fft.rfft
  • numpy.fft.irfft
  • numpy.fft.rfft2
  • numpy.fft.irfft2
  • numpy.fft.rfftn
  • numpy.fft.irfftn
  • numpy.fft.hfft
  • numpy.fft.ihfft
  • numpy.fft.fftfreq
  • numpy.fft.rfftfreq
  • numpy.fft.fftshift
  • numpy.fft.ifftshift

*Rocket-FFT follows SciPy's approach of not allowing duplicate axes

Supported SciPy functions

Most of the scipy.fft module is supported as well, including:

  • scipy.fft.fft
  • scipy.fft.ifft
  • scipy.fft.fft2
  • scipy.fft.ifft2
  • scipy.fft.fftn
  • scipy.fft.ifftn
  • scipy.fft.rfft
  • scipy.fft.irfft
  • scipy.fft.rfft2
  • scipy.fft.irfft2
  • scipy.fft.rfftn
  • scipy.fft.irfftn
  • scipy.fft.hfft
  • scipy.fft.ihfft
  • scipy.fft.hfft2
  • scipy.fft.ihfft2
  • scipy.fft.hfftn
  • scipy.fft.ihfftn
  • scipy.fft.dct
  • scipy.fft.dct2
  • scipy.fft.dctn
  • scipy.fft.idctn
  • scipy.fft.dst
  • scipy.fft.idst
  • scipy.fft.dstn
  • scipy.fft.idstn
  • scipy.fft.fht
  • scipy.fft.ifht
  • scipy.fft.fftshift
  • scipy.fft.ifftshift
  • scipy.fft.fftfreq
  • scipy.fft.ifftfreq
  • scipy.fft.fhtoffset
  • scipy.fft.next_fast_len

Type conversion

By default, Rocket-FFT follows SciPy's approach to type conversion. However, if you would like to use Numpy's approach instead, you can do so by calling the numpy_like function from the rocket_fft namespace:

from rocket_fft import numpy_like, scipy_like

numpy_like()

You can switch back to the SciPy approach by calling the scipy_like function. Keep in mind that these changes must be made before the internal functions of Rocket-FFT are compiled, as the type conversion rule is frozen upon the first compilation.

Compilation time

Rocket-FFT employs multiple strategies to achieve both flexibility in function signatures similar to scipy.fft and numpy.fft, while minimizing compilation times. One of the key approaches is to generate and assemble specialized functions based on the provided type information prior to compilation. This avoids compiling code that will never be executed, and Rocket-FFT can thus limit compilation times to a few hundred milliseconds in most cases. Calls with default arguments are handled specially, resulting in the fastest compilation times.

Limitations on Linux and MacOS

Rocket-FFT uses a C interface to the PocketFFT C++ library. On Linux and MacOS, the C interface functions are accessed via the Python built-in ctypes module due to an unresolved issue with LLVM. This fallback solution results in all function not being cachable, which means that numba.njit(cache=True) does not work. On Windows the C interface is accessed differently and therefore all functions can be cached.

Low-level interface

If you don't need the convenience of the flexible signatures provided by SciPy and Numpy, you can use the low-level interface to the PocketFFT library instead. Using the low-level interface can significantly reduce compilation times and has slightly lower overhead. Additionally, it offers some additional functions that are not available through the Scipy and Numpy interfaces. It is an option to consider if you prioritize speed on small transforms and have a good understanding of how to use FFT. You can import the low-level interface functions from the rocket_fft namespace:

from rocket_fft import c2c, dct, ...

The low-level interface provides the following functions:

from numpy import complex64, complex128, float32, float64, int64, ndarray

# Note that single and double precision can't be mixed
complex_array = ndarray[complex64] | ndarray[complex128]
real_array = ndarray[float32] | ndarray[float64]

def c2c(ain: complex_array, aout: complex_array, axes: ndarray[int64], forward: bool, fct: float64, nthreads: int64) -> None: ...
def r2c(ain: real_array, aout: complex_array, axes: ndarray[int64], forward: bool, fct: float64, nthreads: int64) -> None: ...
def c2r(ain: complex_array, aout: real_array, axes: ndarray[int64], forward: bool, fct: float64, nthreads: int64) -> None: ...
# Like c2c but on real-valued input array and thus using symmetry
def c2c_sym(ain: real_array, aout: complex_array, axes: ndarray[int64], forward: bool, fct: float64, nthreads: int64) -> None: ...
def dst(ain: real_array, aout: real_array, axes: ndarray[int64], type: int64, fct: float64, ortho: bool, nthreads: int64) -> None: ...
def dct(ain: real_array, aout: real_array, axes: ndarray[int64], type: int64, fct: float64, ortho: bool, nthreads: int64) -> None: ...
def separable_hartley(ain: real_array, aout: real_array, axes: ndarray[int64], fct: float64, nthreads: int64) -> None: ...
def genuine_hartley(ain: real_array, aout: real_array, axes: ndarray[int64], fct: float64, nthreads: int64) -> None: ...
def fftpack(ain: real_array, aout: real_array, axes: ndarray[int64], real2hermitian: bool, forward: bool, fct: float64, nthreads: int64) -> None: ...
def good_size(target: int64, real: bool) -> int64: ...

It's important to note that the low-level interface does not provide the same level of safety and convenience as SciPy and Numpy. There is no safety net, and it is up to the user to ensure proper usage. You may even need to refer to the original PocketFFT C++ implementation to understand how to use the functions properly.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rocket-fft-0.0.2.tar.gz (5.3 kB view hashes)

Uploaded Source

Built Distributions

rocket_fft-0.0.2-cp310-cp310-win_amd64.whl (185.4 kB view hashes)

Uploaded CPython 3.10 Windows x86-64

rocket_fft-0.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

rocket_fft-0.0.2-cp310-cp310-macosx_10_9_x86_64.whl (286.6 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

rocket_fft-0.0.2-cp39-cp39-win_amd64.whl (185.4 kB view hashes)

Uploaded CPython 3.9 Windows x86-64

rocket_fft-0.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

rocket_fft-0.0.2-cp39-cp39-macosx_10_9_x86_64.whl (286.6 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

rocket_fft-0.0.2-cp38-cp38-win_amd64.whl (185.4 kB view hashes)

Uploaded CPython 3.8 Windows x86-64

rocket_fft-0.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

rocket_fft-0.0.2-cp38-cp38-macosx_10_9_x86_64.whl (286.6 kB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page