Skip to main content

An analysis framework for KM3NeT

Project description Codacy Badge

KM3Pipe is a framework for KM3NeT related stuff including MC, data files, live access to detectors and databases, parsers for different file formats and an easy to use framework for batch processing.

The main Git repository, where issues and merge requests are managed can be found at

The framework tries to standardise the way the data is processed by providing a Pipeline-class, which can be used to put together different built-in or user made Pumps, Sinks and Modules. Pumps act as data readers/parsers (from files, memory or even socket connections), Sinks are responsible for writing data to disk and Modules take care of data processing, output and user interaction. Such a Pipeline setup can then be used to iteratively process data in a file or from a stream. In our case for example, we store several thousands of neutrino interaction events in a bunch of files and KM3Pipe is used to stitch together an analysis chain which processes each event one-by-one by passing them through a pipeline of modules.

Although it is mainly designed for the KM3NeT neutrino detectors, it can easily be extended to support any kind of data formats. The core functionality is written in a general way and is applicable to all kinds of data processing workflows.

To start off, run:

pip install km3pipe

If you have Docker ( installed, you can start using KM3Pipe immediately by typing:

docker run -it

Feel free to get in touch if you’re looking for a small, versatile framework which provides a quite straightforward module system to make code exchange between your project members as easily as possible. KM3Pipe already comes with several types of Pumps, so it should be easy to find an example to implement your owns. As of version 8.0.0 you find Pumps and Sinks based on popular formats like HDF5 (, ROOT ( but also some very specialised project internal binary data formats, which on the other hand can act as templates for your own ones. Just have a look at the io subpackage and of course the documentation if you’re interested!

Read the latest docs at

KM3NeT public project homepage


Thanks especially to the gracious help of all contributors:

Tamas Gal, Moritz Lotze, Johannes Schumann, Piotr Kalaczynski, Jonas Reubelt, Michael Moser, Thomas Heid, Alba Domi, Agustin Sanchez Losa, Zineb Aly, Jordan Seneca, Nicole Geisselbrecht, Javier Barrios, Valentin Pestel, Jannik Hofestaedt, Matthias Bissinger, Vladimir Kulikovskiy

Project details

Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for km3pipe, version 9.8.0
Filename, size File type Python version Upload date Hashes
Filename, size km3pipe-9.8.0-py3-none-any.whl (205.1 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size km3pipe-9.8.0.tar.gz (359.0 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page