Skip to main content

pspipe

pspipe is the data-analysis pipeline used by the LOFAR Epoch of Reionization and NenuFAR Cosmic Dawn projects. It turns calibrated low-frequency radio MeasurementSets into images, weighted Kelvin visibility cubes, power spectra, and foreground-separated products. It tracks observations and processing revisions so that large, multi-night analyses remain reproducible.

It provides two commands:

  • psdb creates configurations and manages observations and processing revisions;
  • pspipe runs processing tasks on observations registered in that database.

The pipeline uses WSClean for imaging and ps_eor for cubes, flagging, power spectra, and ML-GPR. Optional MeasurementSet-processing tasks also call DP3 and NenuCal.

Documentation

The pspipe documentation follows the complete workflow from installation and calibrated MeasurementSets to images, visibility cubes, power spectra, multi-night combinations, and foreground removal. New users should begin with the getting-started page and then follow the user guide.

The documentation also includes the full configuration, command-line, and Python API references.

Installation

pspipe requires Python 3.10 or newer:

pip install pspipe

For ML-GPR:

pip install "pspipe[ml-gpr]"

Minimal workflow

After installation, create a workspace, register an observation, make its images, and convert them to visibility cubes:

mkdir pspipe-analysis && cd pspipe-analysis
psdb init nenufar /path/to/analysis-data first_run
psdb add_obs first_run.toml NIGHT_001 -m /path/to/ms_lists/NIGHT_001
psdb list_all_obs first_run.toml
pspipe image first_run.toml NIGHT_001
psdb list_rev_img first_run.toml -o NIGHT_001
pspipe gen_vis_cube first_run.toml NIGHT_001

Review the generated configuration before running: in particular the MeasurementSet data column, image and cube UV ranges, field of view, frequency bins, window, and primary beam. Inspect the FITS images and visibility cubes between stages; the separate commands above make those validation gates explicit. Once a setup is established, tasks can be chained with commas. The user guide continues from this point by loading the visibility data and producing power spectra from Python.

Metadata

Release files for pspipe 0.11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pspipe 0.11
File Size Uploaded
pspipe-0.11.tar.gz 46.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pspipe 0.11
File Interpreter ABI Platform
pspipe-0.11-py3-none-any.whl Python 3 none any Details

Total release size: 101.0 kB

Release files / pspipe-0.11.tar.gz

Download URL pspipe-0.11.tar.gz
Size 46.1 kB
Tags Source
SHA-256 checksum
How to use checksums
a3cbafdd0abd09d60deecf61dbc689819eb7f8bfbce20dde73a17480bb81b823
BLAKE2b-256 checksum
How to use checksums
1e756f639b11591089afa86b01c4a5e7f62965b92213c339e133a42ab89a695a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-38-generic

Release files / pspipe-0.11-py3-none-any.whl

Download URL pspipe-0.11-py3-none-any.whl
Size 54.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9bebde1cb9dcd44758defe6f2227008af00539429847f363994f8b1caa25d333
BLAKE2b-256 checksum
How to use checksums
f012c3e5374d1f18e718d208c103296b0d294faab26faedcae78775edbf6c055
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-38-generic

Release history Release notifications | RSS feed

0.12

2 release files

This release

0.11 This release

2 release files

0.10

2 release files

0.9

2 release files

0.8.1

2 release files

0.8

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

0.2

2 release files

0.1.14

2 release files

0.1.13

2 release files

0.1.12

2 release files

0.1.11

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page