Skip to main content

A Kafka based data acquisition and analysis framework

Project description

Dolosse - A Kafka based Data Acquisition System

master codecov

Copyright (c) 2018 - 2020, S. V. Paulauskas, Dolosse Collaboration.

Dolosse is a modern scientific data acquisition and analysis framework. We use Kafka as a messaging backend that allows synchronization between acquisition systems. Using Kafka's messaging interface we can create a feedback loops between analysis and acquisition systems. We're still working on developing the framework

Features

  • Digitizer interfaces (coming soon)
    • XIA
      • Pixie-16
      • XIA Pixie-Net
  • Decode digitizer data formats
    • XIA
      • Pixie-16 (released)
      • Pixie-4 and Pixie-Net (coming soon)
  • Runs on Linux and Windows Systems.
  • Unpacks binary data formats:
    • PLD (UTK)
    • LDF (ORNL) - coming soon

Documentation

Our documentation is sparse right now since we're still getting off the ground. You can read about the project motivation in this presentation. You can also checkout the wiki.

Support

Checkout the support page for more information.

Installation

There are a couple of ways to use the software. They depend on the goal that you're after.

For use in custom software

pip install dolosse

Now you'll have access to the packages and modules we use to build our components. Checkout the modules documentation to see what you can do out of the box.

NOTE: There's nothing that's ready for experiments just yet.

For development

Developers should read the development workflow.

git clone https://github.com/dolosse/dolosse.git
cd dolosse
python3 -m venv venv
pip install -r requirements.txt

Licensing

Apache License 2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for dolosse, version 0.7.0
Filename, size File type Python version Upload date Hashes
Filename, size dolosse-0.7.0-py3-none-any.whl (32.6 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size dolosse-0.7.0.tar.gz (16.3 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page