Skip to main content

A library for LHCb trigger/stripping streams optimization

Project description

The LHCb experiment stores around $10^{11}$ collision events per year. A typical physics analysis deals with a final sample of up to $10^7$ events. Event preselection algorithms (lines) are used for data reduction. Since the data are stored in a format that requires sequential access, the lines are grouped into several output file streams, in order to increase the efficiency of user analysis jobs that read these data. The scheme efficiency heavily depends on the stream composition. By putting similar lines together and balancing the stream sizes it is possible to reduce the overhead. This library implements a method for finding an optimal stream composition.

It takes an arbitary differentiable loss functon and produces a streaming scheme that’s optimized to that loss loss function. For Tesla streams we used $sum_{streams} E(N_{events}) E(N_{lines})$.

Please read more and cite the paper submitted to CHEP proceedings: https://arxiv.org/abs/1702.05262

Installation As of time of writing (09.03.2017), PyPi doesn’t have the required versions of theano and lasagne. You should install them via:

pip install -r https://raw.githubusercontent.com/Lasagne/Lasagne/master/requirements.txt pip install https://github.com/Lasagne/Lasagne/archive/master.zip

then proceed with installing the streams-optimization package: python setup.py install

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

streams_optimization-1.0.0.dev3.tar.gz (13.3 kB view details)

Uploaded Source

Built Distribution

streams_optimization-1.0.0.dev3-py2-none-any.whl (17.5 kB view details)

Uploaded Python 2

File details

Details for the file streams_optimization-1.0.0.dev3.tar.gz.

File metadata

File hashes

Hashes for streams_optimization-1.0.0.dev3.tar.gz
Algorithm Hash digest
SHA256 61a6416598de922f22de76cda5db84d30854f47974397bcedc27921e5641c482
MD5 312e07ea72267f868ac032b31116127f
BLAKE2b-256 0d4bbd04e278b06ccca1a00f04a027aaa992f89fd4c587b3ab56174fd02f7096

See more details on using hashes here.

File details

Details for the file streams_optimization-1.0.0.dev3-py2-none-any.whl.

File metadata

File hashes

Hashes for streams_optimization-1.0.0.dev3-py2-none-any.whl
Algorithm Hash digest
SHA256 c92d21cdd40303b3fcdf167714c5fc40a36b55ba4f4e9898431a15b2b0cafa8b
MD5 a906ae2afcdf647866b865fb7c15d000
BLAKE2b-256 4a00efe524db23fffbac49c3d6e57bc1effa8b6db8320fe05566353326fc4241

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page