Skip to main content

pspipe

pspipe is the data-analysis pipeline used by the LOFAR Epoch of Reionization and NenuFAR Cosmic Dawn projects. It turns calibrated low-frequency radio MeasurementSets into images, weighted Kelvin visibility cubes, power spectra, and foreground-separated products. It tracks observations and processing revisions so that large, multi-night analyses remain reproducible.

It provides two commands:

  • psdb creates configurations and manages observations and processing revisions;
  • pspipe runs processing tasks on observations registered in that database.

The pipeline uses WSClean for imaging and ps_eor for cubes, flagging, power spectra, and ML-GPR. Optional MeasurementSet-processing tasks also call DP3 and NenuCal.

Documentation

The pspipe documentation follows the complete workflow from installation and calibrated MeasurementSets to images, visibility cubes, power spectra, multi-night combinations, and foreground removal. New users should begin with the getting-started page and then follow the user guide.

The documentation also includes the full configuration, command-line, and Python API references.

Installation

pspipe requires Python 3.10 or newer:

pip install pspipe

For ML-GPR:

pip install "pspipe[ml-gpr]"

Minimal workflow

After installation, create a workspace, register an observation, make its images, and convert them to visibility cubes:

mkdir pspipe-analysis && cd pspipe-analysis
psdb init nenufar /path/to/analysis-data first_run
psdb add_obs first_run.toml NIGHT_001 -m /path/to/ms_lists/NIGHT_001
psdb list_all_obs first_run.toml
pspipe image first_run.toml NIGHT_001
psdb list_rev_img first_run.toml -o NIGHT_001
pspipe gen_vis_cube first_run.toml NIGHT_001

Review the generated configuration before running: in particular the MeasurementSet data column, image and cube UV ranges, field of view, frequency bins, window, and primary beam. Inspect the FITS images and visibility cubes between stages; the separate commands above make those validation gates explicit. Once a setup is established, tasks can be chained with commas. The user guide continues from this point by loading the visibility data and producing power spectra from Python.

Release files for pspipe 0.10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pspipe 0.10
File Size Uploaded
pspipe-0.10.tar.gz 46.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pspipe 0.10
File Interpreter ABI Platform
pspipe-0.10-py3-none-any.whl Python 3 none any Details

Total release size: 100.8 kB

Release files / pspipe-0.10.tar.gz

Download URL pspipe-0.10.tar.gz
Size 46.0 kB
Tags Source
SHA-256 checksum
How to use checksums
8761cad9326776efce4b5bdc8086231184d533871570443b1d3d2a53eee358fd
BLAKE2b-256 checksum
How to use checksums
625de8e13cc03b9cb8ceff828278a3e68d414c9311d3fdf6d020a01c0ad2d8bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-28-generic

Release files / pspipe-0.10-py3-none-any.whl

Download URL pspipe-0.10-py3-none-any.whl
Size 54.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a20ada36216f4480c9d09d29fb0c5c988df8424e546b2d095433fb122378c62e
BLAKE2b-256 checksum
How to use checksums
4ea84c3a9350f21c65368ae17ef796db9f5052a3fdf355fbc13da964b0fb986e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-28-generic

Release history Release notifications | RSS feed

This release

0.10 This release

2 release files

0.9

2 release files

0.8.1

2 release files

0.8

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

0.2

2 release files

0.1.14

2 release files

0.1.13

2 release files

0.1.12

2 release files

0.1.11

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page