Skip to main content

HDF5Writer: A simple Data Acquistion Device for Karabo...

Karabo Badge PyPI - Version PyPI - Python Version PyPI - License PyPI - Wheel GitHub language count GitHub top language GitHub contributors GitHub commit activity GitHub Repo stars

... that is extra-data compliant.

Outline

This HDF5Writer device will ingest any data that Karabo can produce (well, except tables that is), and store it into HDF5 files which are extra-data compliant.

All data is stored "as if it were fast-data", i.e. no cloning takes place for slow data, as it would in the full EuXFEL DAQ. This simplifies data bookkeeping substantially.

In order to be compliant with extra-data needs, a fake :slow channel specifier is introduced for slow data, and top-level data nodes are created for any data source. A RUN data section is not created!

A resulting file structure might thus look like:

├INDEX
│ ├FOO
│ │ └BAR
│ │   ├test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:output
│ │   │ └data
│ │   │   ├count  [uint64: 9]
│ │   │   └first  [uint64: 9]
│ │   └test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:slow
│ │     └data
│ │       ├count  [uint64: 9]
│ │       └first  [uint64: 9]
│ ├flag   [int32: 9]
│ ├origin [int32: 9]
│ ├timestamp      [uint64: 9]
│ └trainId        [uint64: 9]
├INSTRUMENT
│ └FOO
│   └BAR
│     ├test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:output
│     │ └data
│     │   └node
│     │     └ndarray      [int32: 1 × 100 × 200]
│     └test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:slow
│       └data
│         ├node
│         │ ├counter      [uint32: 9]
│         │ └counterReadOnly      [uint32: 9]
│         ├state  [256-byte ASCII string: 9]
│         └vectors
│           └stringProperty       [256-byte ASCII string: 9 × 10]
└METADATA
    ...

Interface

The interface is intended to be compatile to the EuXFEL DAQ in terms of states and commands. Currently, no "Pause" funtionality is implemented.

Metadata

Release files for karabo-hdf5writer 3.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for karabo-hdf5writer 3.0.1
File Size Uploaded
karabo_hdf5writer-3.0.1.tar.gz 236.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for karabo-hdf5writer 3.0.1
File Interpreter ABI Platform
karabo_hdf5writer-3.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 271.2 kB

Release files / karabo_hdf5writer-3.0.1.tar.gz

Download URL karabo_hdf5writer-3.0.1.tar.gz
Size 236.7 kB
Tags Source
SHA-256 checksum
How to use checksums
d4ef057f369c4e13622f8c2313e2557e3520442c23c050767b39bc5a12be40b5
BLAKE2b-256 checksum
How to use checksums
9a2ee6f9f1ffb5bc2dc83bd5ab9b347c70a02cd53aba0c20b5031485c8e6754f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.11

Release files / karabo_hdf5writer-3.0.1-py3-none-any.whl

Download URL karabo_hdf5writer-3.0.1-py3-none-any.whl
Size 34.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7815b2dfed89415ca548e02e051a5a620860c42e33253ae18de0050f56af854f
BLAKE2b-256 checksum
How to use checksums
0dd00923bb38455da7d4620a7475b749f874d3b7ba89f7fa70ed146120df5e31
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.11

Release history Release notifications | RSS feed

This release

3.0.1 This release

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page