Monitored Multiprocessing Queues in Python
Project description
What are mnqueues?
mnqueues
stands for Monitored Queues - a coupling between a Queue and a Monitor entity. An abstract Queue is a means for two, or more end points to exchange data. A Monitor collect and alerts on Queue usage statistics.
For example, a Queue may be a multiprocessing.Queue, used for asynchronous exchange of data between two processes, and Monitor alerts when the rate of production is higher than rate of consumption, indicating performance issues on the consumer side.
Tracked measures
mnqueues
tracks several measures per queue:
- Average number of writes to queue per minute,
- Average number of reads to queue per minute,
Supported monitoring systems
- GCP (StackDriver)
Examples
View Google Cloud (GCP) Monitoring dashboard showing queue.put() and queue.get() rates per second, generated by running pytest
on the project tests folder.
Contributing
Contributions are highly appreciated. Please review our
Code of Conduct. Bug reports & feature requests can be left in the Issues
section, or email me at amor71@sgeltd.com
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.