Skip to main content

A Kafka based data acquisition and analysis framework

Project description

Dolosse - A Kafka based Data Acquisition System

master codecov

Copyright (c) 2018 - 2020, S. V. Paulauskas, Dolosse Collaboration.

Dolosse is a modern scientific data acquisition and analysis framework. We use Kafka as a messaging backend that allows synchronization between acquisition systems. Using Kafka's messaging interface we can create a feedback loops between analysis and acquisition systems. We're still working on developing the framework

Features

  • Digitizer interfaces (coming soon)
    • XIA
      • Pixie-16
      • XIA Pixie-Net
  • Decode digitizer data formats
    • XIA
      • Pixie-16 (released)
      • Pixie-4 and Pixie-Net (coming soon)
  • Runs on Linux and Windows Systems.
  • Unpacks binary data formats:
    • PLD (UTK)
    • LDF (ORNL) - coming soon

Documentation

Our documentation is sparse right now since we're still getting off the ground. You can read about the project motivation in this presentation. You can also checkout the wiki.

Support

Checkout the support page for more information.

Installation

There are a couple of ways to use the software. They depend on the goal that you're after.

For use in custom software

pip install dolosse

Now you'll have access to the packages and modules we use to build our components. Checkout the modules documentation to see what you can do out of the box.

NOTE: There's nothing that's ready for experiments just yet.

For development

Developers should read the development workflow.

git clone https://github.com/dolosse/dolosse.git
cd dolosse
python3 -m venv venv
pip install -r requirements.txt

Licensing

Apache License 2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dolosse-0.7.1.tar.gz (22.0 kB view details)

Uploaded Source

Built Distribution

dolosse-0.7.1-py3-none-any.whl (29.1 kB view details)

Uploaded Python 3

File details

Details for the file dolosse-0.7.1.tar.gz.

File metadata

  • Download URL: dolosse-0.7.1.tar.gz
  • Upload date:
  • Size: 22.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0

File hashes

Hashes for dolosse-0.7.1.tar.gz
Algorithm Hash digest
SHA256 d7fb258de57e90a452966aedf2000832bd77e4aaa14d896daf744c1480a3c7ef
MD5 52e2d42d0fa062ec54dd5e02276a638c
BLAKE2b-256 e277b38878484fde300e136fc763bf2f65d6235a13c7c565f25015907e4fb8a2

See more details on using hashes here.

File details

Details for the file dolosse-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: dolosse-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 29.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.7.1 importlib_metadata/4.10.0 pkginfo/1.8.2 requests/2.27.1 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.10.0

File hashes

Hashes for dolosse-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 c68e4b5f86eb9e1cec08c7aba247436311c181d095267eb945e81b51b987d044
MD5 d27d42947d21c0a610d7cc5668b6126e
BLAKE2b-256 eb6f139254d85084d47f09a068d96faa56fa6c192f6a2e45a4cd5d56e6ef69ad

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page