Skip to main content

Moves metrics and alarm state transitions from the Message Queue to the Metrics and Alarms database.

Project description

Team and repository tags
========================

[![Team and repository tags](https://governance.openstack.org/badges/monasca-persister.svg)](https://governance.openstack.org/reference/tags/index.html)

<!-- Change things from this point on -->

monasca-persister
=============

The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn't primarily a Web service it uses DropWizard, https://dropwizard.github.io/dropwizard/, which provides a nice Web application framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor, https://github.com/LMAX-Exchange/disruptor, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the Message Queue.

# Build

Requires monasca-common from https://github.com/openstack/monasca-common. Download and build following instructions in its README.md. Then build monasca-persister by:

```
mvn clean package
```

# Configuration

A sample configuration file is available in java/src/deb/etc/persister-config.yml-sample.

A second configuration file is provided in java/src/main/resources/persister-config.yml for use with the [vagrant "mini-mon" development environment](https://github.com/openstack/monasca-vagrant/).

# TODO

* Purge metrics on shutdown
* Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
* Add better handling of SQL exceptions.
* Complete health check.
* Specify and document the names of the metrics that are available for monitoring of the Persister.
* Document the yaml configuration parameters.

# License

Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied.
See the License for the specific language governing permissions and
limitations under the License.



Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

monasca-persister-1.10.0.tar.gz (75.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

monasca_persister-1.10.0-py2.py3-none-any.whl (55.5 kB view details)

Uploaded Python 2Python 3

File details

Details for the file monasca-persister-1.10.0.tar.gz.

File metadata

File hashes

Hashes for monasca-persister-1.10.0.tar.gz
Algorithm Hash digest
SHA256 140937a2d6d34b96730b04d426857477c076f012d2c21180a483f49655819ece
MD5 36e0f963603b61415981b77dd6d4d47c
BLAKE2b-256 ce20f5024b17f7cc5ee0581dc22d686adaa2711960e38f53326781c7d150684e

See more details on using hashes here.

File details

Details for the file monasca_persister-1.10.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for monasca_persister-1.10.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 32294c5b903477d4fc0facecbff6af4ec66cb366b6e697bf77f2ef599935d45f
MD5 0cb625bf4919a9a0388f7ad92ab0913e
BLAKE2b-256 d739ca7f447fa1b47d87a22684a66a13f5125200226e669903e40ae05fe2611c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page