Skip to main content

XPCS correlation calculations for synchrotron experiments

Project description

xpcs-correlator

License: MIT Repository

Table of contents

  • About
  • Features
  • Requirements
  • Installation
  • Quickstart
  • Configuration / Logging
  • Tests
  • Contributing
  • License
  • Contact

About

This package consolidates ongoing development of correlators for XPCS data analysis at ESRF, with a focus on the ID02 and ID10-coh beamlines.

Features

  • Dense frames data reference and chunked correlator implementations.
  • Calculates g2, g2 errors, and ttcf (2-time correlation function).
  • The ttcf calculations support linear binning for t1,t2 format and hybrid linear log binning for age,lag format.
  • Designed to handle large frame stacks via chunked (partitioned) processing.
  • Supports Dask for both cluster (SLURM) and local parallel execution

Requirements

  • Python 3.10+ (recommended: 3.10, 3.11, 3.12)
  • numpy
  • dask
  • dask_jobqueue
  • h5py
  • hdf5plugin
  • threadpoolctl

Installation

Install in editable/develop mode (recommended during development):

pip install -e .

Install with development extras (for running tests and linters):

pip install -e .[dev]

When published to PyPI the package can be installed with:

pip install xpcs-correlator

Quickstart

Basic usage example — adapt to your data shape and correlator options:

import numpy as np
from xpcscorr import correlator_dense_reference, correlator_dense_chunked

# Replace with your frames array; shape here is (n_frames, nx_pixels, ny_pixels)
frames = np.random.random((100,512, 512))
roimask= np.ones((512,512), dtype=bool)

# Run reference  correlator
result_ref = correlator_dense_reference(frames, roimask)

# Run chunked correlator (handles large data in chunks)
extra_options = {'chunks_N': 3}
result_chunked = correlator_dense_chunked(frames, roimask, extra_options=extra_options)

print(type(result_ref), type(result_chunked))

Notes:

  • Replace the synthetic frames with your real dataset (HDF5 dataset or numpy array).
  • Check correlator function docstrings for exact argument names and options.

Configuration / Logging

Control logging with environment variables used by the package (see src/xpcscorr/__init__.py):

  • XPCSCORR_LOG_TO_CLI — set to 1 to enable logging to stdout (default in development)
  • XPCSCORR_LOG_TO_FILE — set to 1 to enable logging to a file named xpcscorr.log

Example:

export XPCSCORR_LOG_TO_CLI=1
export XPCSCORR_LOG_TO_FILE=0

Tests

Run tests with pytest:

pip install -e .[dev]
pytest -q

There are unit tests under tests/ that exercise correlator behavior and core utilities.

Contributing

  • Open issues for bugs or feature requests.
  • Fork the repo, create a feature branch, add tests, and submit a pull request.
  • Keep changes small, document API changes, and add tests for new behavior.

License

This project is licensed under the MIT License — see the LICENSE file for details.

Contact

Maintainer: Maciej Jankowski — maciej.jankowski@esrf.fr

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xpcs_correlator-0.1.0.tar.gz (34.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

xpcs_correlator-0.1.0-py3-none-any.whl (34.1 kB view details)

Uploaded Python 3

File details

Details for the file xpcs_correlator-0.1.0.tar.gz.

File metadata

  • Download URL: xpcs_correlator-0.1.0.tar.gz
  • Upload date:
  • Size: 34.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.11

File hashes

Hashes for xpcs_correlator-0.1.0.tar.gz
Algorithm Hash digest
SHA256 31ccd65621dadbc7fc47bd72559d276aa4a6d99b5580e2604d8f46fad9a9fa09
MD5 2d5131a870f09167a5eba8971727cfc3
BLAKE2b-256 0575b955caa44bb34aaea23ab956485f29917626213a5783c3cf054c661d4bad

See more details on using hashes here.

File details

Details for the file xpcs_correlator-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for xpcs_correlator-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 580751bd5d43ed1350358936f931673954be85058837a95c0a308f181e8a4a44
MD5 a2c33c490acd0a3c9f6ab30ceea79702
BLAKE2b-256 01d53430f944511b48c7775768bca5e221370885c8c4eae939a7a59c6fc953ef

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page