Skip to main content

summarytable

real time data processing result summary at NSLS-II MX beamlines
D. Kreitler, 18Dec2020 updated 16May2022

summarytable is a python script that summarizes results from within mx data directories created by LSDC.

The script does the following:

  • parses fast_dp.xml or autoPROC.xml files from auto processing pipelines
  • prints the results to console in real time as results are available
  • Concurrently updates result summaries to a file called "fast_dp.summary.txt" or "autoPROC.summary.txt"

Set-up

This script is can be run within the NSLS-II network on a machine that has access to Lustre/GPFS.

Installation

Try installing as a python3 package in your profile
For instance on a beamline workstation.

pip3 install summarytable  --user

Or try installing with pip3 on your home workstation

pip3 install summarytable

Online/realtime Usage

Multiple users can monitor data directories in real time.
In your mx data directory, cd to the fast_dp_dir or autoProc_dir directory

run:
summarytable

The .csv file will be written when the process is stopped with Ctrl-C.

Offline Usage

run:
summarytable_offline

The .txt file and .csv file will be written immediately in the working directory.

Output

Summary table of results will be updated in files ending with .summary.txt and .summary.csv
in the working directory.
These files can be opened in Microsoft Excel or LibreOffice using commas/spaces as a delimiter.

/GPFS/CENTRAL/xf17id2/inhouse/Startup-2020-03/mx305000-69
                             |---------------Overall------------------||-------------Outer-Shell----------------|
                  Sample Path     Hi     Lo  R_mrg   cc12   comp   mult     Hi     Lo  R_mrg   cc12   comp   mult        symm      a      b      c  alpha   beta  gamma
             Mpro-oil-apo-2/4   2.44  28.00  0.112   0.98  98.50   3.50   2.44   2.50  0.498   0.73  96.20   3.60     C 1 2 1  114.2   54.0   44.8   90.0  101.3   90.0
             Mpro-oil-apo-3/3   2.47  27.70  0.097   0.99  99.60   3.50   2.47   2.53  0.664   0.72  97.70   3.50     C 1 2 1  113.2   53.6   44.6   90.0  101.9   90.0
             Mpro-oil-apo-4/4   2.54  27.58  0.100   0.99  99.40   3.50   2.54   2.61  0.546   0.66  95.00   3.40     C 1 2 1  112.8   53.5   44.7   90.0  102.0   90.0
             Mpro-oil-apo-6/3   2.70  27.80  0.099   0.99  99.60   3.50   2.70   2.77  0.830   0.56  98.60   3.60     C 1 2 1  113.5   53.8   44.7   90.0  101.7   90.0
             Mpro-oil-apo-7/4   2.27  27.96  0.087   0.99  99.60   3.50   2.27   2.33  0.688   0.52  97.80   3.30     C 1 2 1  114.1   53.9   44.8   90.0  101.5   90.0
            Mpro-oil-apo-10/3   2.06  28.06  0.057   1.00  99.30   3.50   2.06   2.11  0.724   0.61  94.30   3.40     C 1 2 1  114.5   54.0   44.9   90.0  101.4   90.0

Metadata

Release files for summarytable 0.1.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for summarytable 0.1.8
File Size Uploaded Provenance Actions
summarytable-0.1.8.tar.gz 6.4 kB Without provenance Details for summarytable-0.1.8.tar.gz

Release files / summarytable-0.1.8.tar.gz

Download URL summarytable-0.1.8.tar.gz
Size 6.4 kB
Tags Source
SHA-256 checksum
How to use checksums
a3514d5baa119ce3baf891ca50898977875723b8caafd9affe9e7a58f926e6ed
BLAKE2b-256 checksum
How to use checksums
148154435f2763c475390da7746405c1732819994c2030f1acf3ad38f82276ac
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.9.5

Security for summarytable 0.1.8

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page