Skip to main content

A simple data sink that will swallow any Karabo Data Source(s)

Project description

HDF5Writer: A simple Data Acquistion Device for Karabo...

Karabo Badge PyPI - Version PyPI - Python Version PyPI - License PyPI - Wheel GitHub language count GitHub top language GitHub contributors GitHub commit activity GitHub Repo stars

... that is extra-data compliant.

Outline

This HDF5Writer device will ingest any data that Karabo can produce (well, except tables that is), and store it into HDF5 files which are extra-data compliant.

All data is stored "as if it were fast-data", i.e. no cloning takes place for slow data, as it would in the full EuXFEL DAQ. This simplifies data bookkeeping substantially.

In order to be compliant with extra-data needs, a fake :slow channel specifier is introduced for slow data, and top-level data nodes are created for any data source. A RUN data section is not created!

A resulting file structure might thus look like:

├INDEX
│ ├FOO
│  └BAR
│    ├test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:output
│     └data
│       ├count  [uint64: 9]       └first  [uint64: 9]    └test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:slow
│      └data
│        ├count  [uint64: 9]        └first  [uint64: 9] ├flag   [int32: 9] ├origin [int32: 9] ├timestamp      [uint64: 9] └trainId        [uint64: 9]
├INSTRUMENT
│ └FOO
│   └BAR
│     ├test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:output
│      └data
│        └node
│          └ndarray      [int32: 1 × 100 × 200]     └test-mdl-08c59409-61fe-4745-afd8-186a82d1bcd6:slow
│       └data
│         ├node
│          ├counter      [uint32: 9]          └counterReadOnly      [uint32: 9]         ├state  [256-byte ASCII string: 9]         └vectors
│           └stringProperty       [256-byte ASCII string: 9 × 10]
└METADATA
    ...

Interface

The interface is intended to be compatile to the EuXFEL DAQ in terms of states and commands. Currently, no "Pause" funtionality is implemented.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

karabo_hdf5writer-3.0.1.tar.gz (236.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

karabo_hdf5writer-3.0.1-py3-none-any.whl (34.5 kB view details)

Uploaded Python 3

File details

Details for the file karabo_hdf5writer-3.0.1.tar.gz.

File metadata

  • Download URL: karabo_hdf5writer-3.0.1.tar.gz
  • Upload date:
  • Size: 236.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for karabo_hdf5writer-3.0.1.tar.gz
Algorithm Hash digest
SHA256 d4ef057f369c4e13622f8c2313e2557e3520442c23c050767b39bc5a12be40b5
MD5 d4d84461321b002906fe309d2da0cf6d
BLAKE2b-256 9a2ee6f9f1ffb5bc2dc83bd5ab9b347c70a02cd53aba0c20b5031485c8e6754f

See more details on using hashes here.

File details

Details for the file karabo_hdf5writer-3.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for karabo_hdf5writer-3.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7815b2dfed89415ca548e02e051a5a620860c42e33253ae18de0050f56af854f
MD5 567118d5ed10b1e62ddfbefacf77b0d5
BLAKE2b-256 0dd00923bb38455da7d4620a7475b749f874d3b7ba89f7fa70ed146120df5e31

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page