Skip to main content

Package allowing the conversion and analysis of SAXS and WAXS data (EDF format) that's fresh out of the machine. This package convertis the EDF files to an HDF5 file with the NeXus standard for the x-ray community.

Project description

SWAXSanalysis


This package is used to convert edf files that contain one header and one dataset into an HDF5 file that contains information selected by the user.

Versioning Y.X1.X2.X3 :

  • Y : year of release
  • X1 : Big update (refactoring, new GUI, new way to use...)
  • X2 : Update including new functionality.
  • X3 : If 0, stable release, if not, it's a work in progress

How it works


To convert the EDF file, the program uses a configuration file created by the user. To help create said file, a GUI is provided. This same GUI can be used to do basic processes to an HDF5 file that follows the NXcanSAS definition, as described by the NeXus Foundation : https://manual.nexusformat.org/classes/applications/NXcanSAS.html#nxcansas

Once the configuration file has been created it should be saved in the "configs" folder inside the Data Treatment Center. You need to move the config file inside the Data Treatment Center directly for it to be detected and used in the conversion of file. By default, the Data Treatment Center is created on your desktop.

Once the config file is moved, you can put the EDF files you want to convert to hdf5 in the Treatment Queue folder.

You can also use the package directly in a python script by importing the main class and some utility functions :

from SWAXSanalysis.class_nexus_file import NexusFile
from SWAXSanalysis.utils import save_data, extract_from_h5, delete_data

In any case, an example notebook along with a jupyter notebook launcher is present in the Data Treatment Center.

How to install


You have to activate a python virtual environment (more info on how to activate a Venv here) and type the following command :

pip install SWAXSanalysis

After SWAXSanalysis is installed you need to install this branch of smi_analysis via the following command

pip install git+https://github.com/gfreychet/smi-analysis.git@master

This wraps up the installation of the package in the activated virtual environment. If you want to use the GUI, you only need to type

SWAXSanalysis

in the same activated virtual environment

The conversion process can be automated if the launcher.py has been launched with the argument --jenkins "true" like so :

python3 -m SWAXSanalysis.launcher --jenkins true 

Changing the location of the Data Treatment Center


By default, the Data Treatment Center and Treatment Queue folder will be created on your desktop. To change the location of the Data Treatment Center, go to :

path\to\your\venv\Lib\site-packages\SWAXSanalysis

and open the __init__.py file. In this file, find this line (should be line N°28) :

ENV_PATH: Path = DESKTOP_PATH

And change it to

ENV_PATH: Path = Path(r"path\where\Data Treatment Center\should\be")

Implementing new code


New process

To add a new process to the code, simply go to the class_nexus_file.py and in the class NexusFile, you can define a new method. There are some things you should know :

  1. If you want your process to be used only in script, there is no special condition. However if you want it to be picked up by the GUI, the method's name must start with process_....
  2. If you want the process to be available in the GUI. You have to follow this signature standard :
def process_example(
            self,
            param1: type1 = default1,
            param2: type2 = default2,
            param3: type3 = default3
    ) -> None:
    pass

You need to type your variables and give it a default value. You can put any default value but None or "" are the most generic ones. Don't hesitate to look at the other processes to guide you.

To learn more about typing :
https://mypy.readthedocs.io/en/stable/cheat_sheet_py3.html 3. A process must include a for loop to apply the process to all files :

for index, smi_data in enumerate(self.list_smi_data):
    pass

Usually, we iterate over self.list_smi_data since it's the pre-processed data and it was corrected via pyFAI. But should you want to iterate over the HDF5 files directly you can use self.nx_files.
This loop should encompass al the code that actually treats and manipulate the smi_data.

  1. If you want to add a way to save data you need to use the save_data function, present in the same file.
  2. If you want to add a way to display data you need to use the _display_data method. This method is quite complex so don't hesitate to look at other processes to see how to use it properly.

Testing new implementation


When implementing new code in the package, you should always test if you broke something. To do so, you have a few test that you can conduct. Those test are present in the tests folder of the github project. In this folder you have :

  • test_conversion : which is a test that should always be run
  • test_new_nexus_def : this test should be run in case you have implemented a new NeXus definition

Known issues


  • Changing the ENV_PATH by changing the __init__.py script is impractical.
  • While creating the configuration file, there is no way to choose the NeXus definition, meaning that you have to change the loaded definition in the python script directly.
  • The program can't handle anything other than EDF file with one header and one dataset
  • Azimuthal angle range is behaving weirdly when 0 is not in the range
  • 2 param intensity is still a bit of a work in progress but should work as long as you do not use it with the batch option enabled
  • While processing something in the data processing tab, the windows stops responding but everything it is still processing.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

swaxsanalysis-2025.4.2.0.tar.gz (9.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

swaxsanalysis-2025.4.2.0-py3-none-any.whl (9.9 MB view details)

Uploaded Python 3

File details

Details for the file swaxsanalysis-2025.4.2.0.tar.gz.

File metadata

  • Download URL: swaxsanalysis-2025.4.2.0.tar.gz
  • Upload date:
  • Size: 9.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.11

File hashes

Hashes for swaxsanalysis-2025.4.2.0.tar.gz
Algorithm Hash digest
SHA256 1e3085b1266095ba2057f2dd7b2dc87f54ba7b38b1527ffe1a4e70c165c3ebbe
MD5 d61e985ef383f6ee14ddf5bba59f657e
BLAKE2b-256 14680689f865e94495129507e46c64f898ec309b58ba5b659f3d90d1d84a3b0f

See more details on using hashes here.

File details

Details for the file swaxsanalysis-2025.4.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for swaxsanalysis-2025.4.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 54e43b23a148f16678d58f6113686a5d32d9e737c06539fb9b23bacdf9de1afa
MD5 87587ca11fe775b58b057d344a2879a9
BLAKE2b-256 c266344948721e94825ee56d32d119fd5684a246556fb7cac2767435eaf2e496

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page