Skip to main content

pspipe

pspipe is the data-analysis pipeline used by the LOFAR Epoch of Reionization and NenuFAR Cosmic Dawn projects. It turns calibrated low-frequency radio MeasurementSets into images, weighted Kelvin visibility cubes, power spectra, and foreground-separated products. It tracks observations and processing revisions so that large, multi-night analyses remain reproducible.

It provides two commands:

  • psdb creates configurations and manages observations and processing revisions;
  • pspipe runs processing tasks on observations registered in that database.

The pipeline uses WSClean for imaging and ps_eor for cubes, flagging, power spectra, and ML-GPR. Optional MeasurementSet-processing tasks also call DP3 and NenuCal.

Documentation

The pspipe documentation follows the complete workflow from installation and calibrated MeasurementSets to images, visibility cubes, power spectra, multi-night combinations, and foreground removal. New users should begin with the getting-started page and then follow the user guide.

The documentation also includes the full configuration, command-line, and Python API references.

Installation

pspipe requires Python 3.10 or newer:

pip install pspipe

For ML-GPR:

pip install "pspipe[ml-gpr]"

Minimal workflow

After installation, create a workspace, register an observation, make its images, and convert them to visibility cubes:

mkdir pspipe-analysis && cd pspipe-analysis
psdb init nenufar /path/to/analysis-data first_run
psdb add_obs first_run.toml NIGHT_001 -m /path/to/ms_lists/NIGHT_001
psdb list_all_obs first_run.toml
pspipe image first_run.toml NIGHT_001
psdb list_rev_img first_run.toml -o NIGHT_001
pspipe gen_vis_cube first_run.toml NIGHT_001

Review the generated configuration before running: in particular the MeasurementSet data column, image and cube UV ranges, field of view, frequency bins, window, and primary beam. Inspect the FITS images and visibility cubes between stages; the separate commands above make those validation gates explicit. Once a setup is established, tasks can be chained with commas. The user guide continues from this point by loading the visibility data and producing power spectra from Python.

Metadata

Release files for pspipe 0.12

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pspipe 0.12
File Size Uploaded
pspipe-0.12.tar.gz 46.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pspipe 0.12
File Interpreter ABI Platform
pspipe-0.12-py3-none-any.whl Python 3 none any Details

Total release size: 101.6 kB

Release files / pspipe-0.12.tar.gz

Download URL pspipe-0.12.tar.gz
Size 46.4 kB
Tags Source
SHA-256 checksum
How to use checksums
95dc3dcef423775236e6c0d4cc9e75d33e6aa7aace9e7bba711836c42fee90d9
BLAKE2b-256 checksum
How to use checksums
79231fa48b03e84ebc25769d9760c0eb8084d6c9692cf0210446170146f5fe66
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-38-generic

Release files / pspipe-0.12-py3-none-any.whl

Download URL pspipe-0.12-py3-none-any.whl
Size 55.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
be89d6a99efd6dc5e15b9cb5494aec37529c7d45e2ce78d29642c2ef60447406
BLAKE2b-256 checksum
How to use checksums
0d4762cb7bc0f5abae4089482615c6fd01049c3ed85b263aa919a7ff04b69b29
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.4.1 CPython/3.14.4 Linux/7.0.0-38-generic

Release history Release notifications | RSS feed

This release

0.12 This release

2 release files

0.11

2 release files

0.10

2 release files

0.9

2 release files

0.8.1

2 release files

0.8

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5

2 release files

0.4

2 release files

0.3

2 release files

0.2

2 release files

0.1.14

2 release files

0.1.13

2 release files

0.1.12

2 release files

0.1.11

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page