Skip to main content

XPCS correlation calculations for synchrotron experiments

Project description

xpcs-correlator

License: MIT Repository

Table of contents

  • About
  • Documentation
  • Features
  • Requirements
  • Installation
  • Quickstart
  • Configuration / Logging
  • Tests
  • Contributing
  • License
  • Contact

About

This package consolidates ongoing development of correlators for XPCS data analysis at ESRF, with a focus on the ID02 and ID10-coh beamlines.

Documentation

The documentation is hosted online: https://mj.gitlab-pages.esrf.fr/xpcs_developments/xpcscorr/

Features

  • Dense frames data reference and chunked correlator implementations.
  • Calculates g2, g2 errors, and ttcf (2-time correlation function).
  • The ttcf calculations support linear binning for t1,t2 format and hybrid linear log binning for age,lag format.
  • Designed to handle large frame stacks via chunked (partitioned) processing.
  • Supports Dask for both cluster (SLURM) and local parallel execution

Requirements

  • Python 3.10+ (recommended: 3.10, 3.11, 3.12)
  • numpy
  • numba
  • dask
  • dask_jobqueue
  • h5py
  • hdf5plugin
  • threadpoolctl

Installation

Install in editable/develop mode (recommended during development):

pip install -e .

Install with development extras (for running tests and linters):

pip install -e .[dev]

Install from PyPI the package for regular use:

pip install xpcs-correlator

Quickstart

For a step-by-step walkthrough with examples and runnable code, see the Tutorial in the online documentation: Tutorial.

Basic usage example — adapt to your data shape and correlator options:

import numpy as np
from xpcscorr import correlator_dense_reference, correlator_dense_chunked

# Replace with your frames array; shape here is (n_frames, nx_pixels, ny_pixels)
frames = np.random.random((100,512, 512))
roimask= np.ones((512,512), dtype=bool)

# Run reference  correlator
result_ref = correlator_dense_reference(frames, roimask)

# Run chunked correlator (handles large data in chunks)
extra_options = {'chunks_N': 3}
result_chunked = correlator_dense_chunked(frames, roimask, extra_options=extra_options)

print(type(result_ref), type(result_chunked))

Notes:

  • Replace the synthetic frames with your real dataset (HDF5 dataset or numpy array).
  • Check correlator function docstrings for exact argument names and options.

Configuration / Logging

Control logging with environment variables used by the package (see src/xpcscorr/__init__.py):

  • XPCSCORR_LOG_TO_CLI — set to 1 to enable logging to stdout (default in development)
  • XPCSCORR_LOG_TO_FILE — set to 1 to enable logging to a file named xpcscorr.log

Example:

export XPCSCORR_LOG_TO_CLI=1
export XPCSCORR_LOG_TO_FILE=0

Tests

Run tests with pytest:

pip install -e .[dev]
pytest -q

There are unit tests under tests/ that exercise correlator behavior and core utilities.

Contributing

  • Open issues for bugs or feature requests.
  • Fork the repo, create a feature branch, add tests, and submit a pull request.
  • Keep changes small, document API changes, and add tests for new behavior.

License

This project is licensed under the MIT License — see the LICENSE file for details.

Contact

Maintainer: Maciej Jankowski — maciej.jankowski@esrf.fr

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

xpcs_correlator-0.2.0.tar.gz (1.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

xpcs_correlator-0.2.0-py3-none-any.whl (41.6 kB view details)

Uploaded Python 3

File details

Details for the file xpcs_correlator-0.2.0.tar.gz.

File metadata

  • Download URL: xpcs_correlator-0.2.0.tar.gz
  • Upload date:
  • Size: 1.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.11

File hashes

Hashes for xpcs_correlator-0.2.0.tar.gz
Algorithm Hash digest
SHA256 163cc7002e577f3f54841c1c416d2c8d69f47bbfb15e4a47434d31d43ddc714e
MD5 673b5614f3154d16a6cb606cad15f70b
BLAKE2b-256 3602092f8b4b3ba440c3ecf08182b42230c61b68dfd45ca3ca4a154bd93ba110

See more details on using hashes here.

File details

Details for the file xpcs_correlator-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for xpcs_correlator-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6d0650fb9b2fae21bc979dc9c1f46db9cc9f3a7b1095e43bae340aec03d8a537
MD5 5d4b7e0ce085c27ef008f7a7b26a239d
BLAKE2b-256 216e81645168eb328e969332cd5d613101c5b3293de2df937592987b3108ae64

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page