Skip to main content

A package to calibrate and image MWA solar observation

Project description

P-AIRCARS Logo

P-AIRCARS

An automated spectropolarimetric calibration and imaging pipeline designed for solar radio observations using the Murchision Widefield Array (MWA) radio telescope. It performs end-to-end calibration, flagging, and imaging with a focus on dynamic solar data, supporting both spectral and temporal flexibility in imaging products.

Background

Solar radio data presents unique challenges due to the high variability and brightness of the Sun, as well as the need for high time-frequency resolution. The P-AIRCARS pipeline addresses these challenges by:

  • Automating the calibration of interferometric data, including flux, phase, and polarization calibrations
  • Supporting time-sliced and frequency-sliced imaging workflows
  • Leveraging Dask for scalable parallel processing
  • Providing hooks for integration with contextual data from other wavelegths for enhanced solar analysis

Documentation

P-AIRCARS documentation is available at: p-aircars.readthedocs.io

Software environment

P-AIRCARS is tested on Ubuntu22, Ubuntu 24, and CentOS 7 with Python 3.10. P-AIRCARS may not work in other operating system and python versions. If user wants to use P-AIRCARS in other environments, limited support is available in debugging or solving the issues. User may look at Containersed Use section in the docuement for these scenarios.

Quickstart

P-AIRCARS is distributed on PyPI. To use it, install it in isolated conda environment. If conda is not installed in your system, see document for Conda installation instructions.

  1. Set some environment variable

     export PYTHONNOUSERSITE=1
      
     unset PYTHONPATH  
    
  2. Create conda environment with python 3.10 with compaitable C/C++ libraries

    conda create -n paircars_env --override-channels -c conda-forge python=3.10 gcc_linux-64=14 gxx_linux-64=14 gfortran_linux-64=14 cmake pkg-config pip
    
    conda activate paircars_env
    

    We suggest using Mamba for fast conda installtion and environment creation.

  3. Install P-AIRCARS in conda environment

    pip install paircars
    
  4. Initiate necessary metadata

    init-paircars-setup --init
    

    By default, the necessary data will be saved in home directory and requires about 20 GB of disk space. We suggest using any other location with larger disk space and specify that by --datadir </full/path/to/paircars_datadir> in the above command.

  5. Before running the pipeline, setup your data as following:

    -- Create a <target_datadir> and put all coarse channel measurement sets of solar scan of a single observation ID (OBSID) inside it.

    -- Create a <cal_datadir> and put all coarse channel measurement sets for calibrator observation of a single OBSID inside it.

  6. Run P-AIRCARS pipeline

    run-mwa-paircars <full path of target measurement set directory> --cal_datadir <full path of calibrator measurement set directory> --workdir <full path of work directory> --outdir <full path of output products directory>
    

    N.B.: Always provide the entire direcotry path. Short path or only directory name may cause errors. Keep target measurement sets for a single OBSID and calibrator measurement sets for a single OBSID must be kept in seperate directories. If calibrator is not present, do not provide these information.

That's all. You started P-AIRCARS pipeline for analysing your MWA solar observation 🎉.

  1. To see all running P-AIRCARS jobs

    show-paircars-status --show
    
  2. If P-AIRCARS is running in a local machine, see local log of any job using the

    run-mwa-mwalogger --jobid <jobid>
    

    N.B.: If you are running P-AIRCARS is cluster environment, first checkout HPC Settings in the document for viewing P-AIRCARS log remotely using prefect dashboard.

  3. Output products will be saved in : <path of output products directory>

Sample dataset

User can download and test entire P-AIRCARS pipeline using the sample dataset available in Zenodo: https://doi.org/10.5281/zenodo.18641232. Do not use this sample dataset for any publication without permission from the developer.

SolarViewer

To view and analyse final image products, we recommend using SolarViewer.

Acknowledgements

P-AIRCARS is developed by Devojyoti Kansabanik (NCRA-TIFR, Pune, India and CPAESS-UCAR, Boulder, USA) and an incarnation of AIRCARS. Other contributors are, Surajt Mondal (NCRA-TIFR, Pune, India), Soham Dey (NCRA-TIFR, Pune, India), and Puja Majee (NCRA-TIFR, Pune, India). If you use P-AIRCARS for analysing your MWA solar observations, include the following statement in your paper, and cite the following papers:

This MWA solar observations are analysed using P-AIRCARS pipeline. 
  1. Cite P-AIRCARS software in zenodo: [https://doi.org/10.5281/zenodo.18625477][kansbanikzenodo]
  1. Kansabanik et al., 2025, ApJS, v278:26
  1. Kansabanik et al., 2023, ApJS, v264:47
  1. Kansabanik et al., 2022, ApJ, v932:110
  1. Kansbanik 2022, Solar Physics, v297:122
  1. Mondal et al., 2019, ApJ, v875:97

If you use observations before 2015, include this additonal statement and citation:

Flux calibration of the observations are done using the menthod described in the following paper.
  1. Kansabanik et al., 2022, ApJ, v927:17

P-AIRCARS name is given by Dr. Barnali Das (NCRA-TIFR, Pune, India)

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

paircars-3.0.4.tar.gz (256.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

paircars-3.0.4-py3-none-any.whl (289.2 kB view details)

Uploaded Python 3

File details

Details for the file paircars-3.0.4.tar.gz.

File metadata

  • Download URL: paircars-3.0.4.tar.gz
  • Upload date:
  • Size: 256.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for paircars-3.0.4.tar.gz
Algorithm Hash digest
SHA256 ea82785c530e335103a433dc535e2e881ebdfc0175b14e851bcfda0e68df5aa7
MD5 3de7cccf9cfb143967fa487ce3e5ac39
BLAKE2b-256 8b36d91994788c7b98d5ac76b81aff0255bb57fbfafb22a06eeae7dd02061087

See more details on using hashes here.

File details

Details for the file paircars-3.0.4-py3-none-any.whl.

File metadata

  • Download URL: paircars-3.0.4-py3-none-any.whl
  • Upload date:
  • Size: 289.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.20

File hashes

Hashes for paircars-3.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ad04db83520ae1d515b659887094c86dfa9d4d8197287e845fd166d032082214
MD5 9f3df06265de632525879195ce469a53
BLAKE2b-256 1c61be4811d1537185bce30114c57d81f6a2815a14f187c413f76bd1aed16625

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page