BioMAJ process service
Project description
# About
Microservice to manage the process execution of biomaj.
A protobuf interface is available in biomaj_process/message/message_pb2.py to exchange messages between BioMAJ and the download service. Messages go through RabbitMQ (to be installed).
# Protobuf
To compile protobuf, in biomaj_process/message:
protoc –python_out=. message.proto
# Development
flake8 biomaj_process
# Run
## Message consumer: export BIOMAJ_CONFIG=path_to_config.yml python bin/biomaj_process_consumer.py
## Web server
If package is installed via pip, you need a file named gunicorn_conf.py containing somehwhere on local server:
- def worker_exit(server, worker):
from prometheus_client import multiprocess multiprocess.mark_process_dead(worker.pid)
If you cloned the repository and installed it via python setup.py install, just refer to the gunicorn_conf.py in the cloned repository.
export BIOMAJ_CONFIG=path_to_config.yml rm -rf ..path_to/godocker-prometheus-multiproc mkdir -p ..path_to/godocker-prometheus-multiproc export prometheus_multiproc_dir=..path_to/godocker-prometheus-multiproc gunicorn biomaj_download.biomaj_process_web:app
Web processes should be behind a proxy/load balancer, API base url /api/download
- 3.0.7:
fix case if process desc or type is missing in bank properties
- 3.0.6:
disable web thread logging
- 3.0.5:
retry in case of contact failure with proxy
- 3.0.4:
for docker, restrict directory to bank directory and dependencies add host in prometheus stats
- 3.0.3:
fix prometheus + gunicorn multi process add consul supervision
- 3.0.2:
add logging info execute docker processes in biomaj micro service
- 3.0.1:
bug fixes
- 3.0.0:
move process management out of biomaj main package
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for biomaj_process-3.0.7-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2062b313acfcfbb644c4b0018755a5860a1557cd5779361b3d0503bc4dc528b0 |
|
MD5 | 318c0f5621b2cd331740385cb4babfd7 |
|
BLAKE2b-256 | b296629e8fabacc4674fe030017d475a774447020578b3dbb34720adae7abdee |