summarytable
real time data processing result summary at NSLS-II MX beamlines
D. Kreitler, 18Dec2020
updated 16May2022
summarytable is a python script that summarizes results from within mx data directories created by LSDC.
The script does the following:
- parses fast_dp.xml or autoPROC.xml files from auto processing pipelines
- prints the results to console in real time as results are available
- Concurrently updates result summaries to a file called "fast_dp.summary.txt" or "autoPROC.summary.txt"
Set-up
This script is can be run within the NSLS-II network on a machine that has access to Lustre/GPFS.
Installation
Try installing as a python3 package in your profile
For instance on a beamline workstation.
pip3 install summarytable --user
Or try installing with pip3 on your home workstation
pip3 install summarytable
Online/realtime Usage
Multiple users can monitor data directories in real time.
In your mx data directory, cd to the fast_dp_dir or autoProc_dir directory
run:
summarytable
The .csv file will be written when the process is stopped with Ctrl-C.
Offline Usage
run:
summarytable_offline
The .txt file and .csv file will be written immediately in the working directory.
Output
Summary table of results will be updated in files ending with .summary.txt and .summary.csv
in the working directory.
These files can be opened in Microsoft Excel or LibreOffice using commas/spaces as a delimiter.
/GPFS/CENTRAL/xf17id2/inhouse/Startup-2020-03/mx305000-69
|---------------Overall------------------||-------------Outer-Shell----------------|
Sample Path Hi Lo R_mrg cc12 comp mult Hi Lo R_mrg cc12 comp mult symm a b c alpha beta gamma
Mpro-oil-apo-2/4 2.44 28.00 0.112 0.98 98.50 3.50 2.44 2.50 0.498 0.73 96.20 3.60 C 1 2 1 114.2 54.0 44.8 90.0 101.3 90.0
Mpro-oil-apo-3/3 2.47 27.70 0.097 0.99 99.60 3.50 2.47 2.53 0.664 0.72 97.70 3.50 C 1 2 1 113.2 53.6 44.6 90.0 101.9 90.0
Mpro-oil-apo-4/4 2.54 27.58 0.100 0.99 99.40 3.50 2.54 2.61 0.546 0.66 95.00 3.40 C 1 2 1 112.8 53.5 44.7 90.0 102.0 90.0
Mpro-oil-apo-6/3 2.70 27.80 0.099 0.99 99.60 3.50 2.70 2.77 0.830 0.56 98.60 3.60 C 1 2 1 113.5 53.8 44.7 90.0 101.7 90.0
Mpro-oil-apo-7/4 2.27 27.96 0.087 0.99 99.60 3.50 2.27 2.33 0.688 0.52 97.80 3.30 C 1 2 1 114.1 53.9 44.8 90.0 101.5 90.0
Mpro-oil-apo-10/3 2.06 28.06 0.057 1.00 99.30 3.50 2.06 2.11 0.724 0.61 94.30 3.40 C 1 2 1 114.5 54.0 44.9 90.0 101.4 90.0
Metadata
Release files for summarytable 0.1.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| summarytable-0.1.8.tar.gz | 6.4 kB | Without provenance | Details for summarytable-0.1.8.tar.gz |
Release files / summarytable-0.1.8.tar.gz
| Download URL | summarytable-0.1.8.tar.gz |
|---|---|
| Size | 6.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a3514d5baa119ce3baf891ca50898977875723b8caafd9affe9e7a58f926e6ed
|
|
BLAKE2b-256 checksum How to use checksums |
148154435f2763c475390da7746405c1732819994c2030f1acf3ad38f82276ac
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.9.5
|
Security for summarytable 0.1.8
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.