SIP Processing Block Controller library.
Project description
SKA SDP SIP Processing Block Controller
Library and Celery worker image for executing Processing Block workflows within the SDP SIP prototype code. This is implemented as a set of Celery tasks which can be used to asynchronously execute SIP Processing Block workflows on a Processing Block Controller (Celery Worker) instance.
Library installation
pip install skasip-pbc
Starting a containerised PBC instance
For the Processing Block Controller to function, a Redis Database instance must be created, which provides the role of the Celery Broker and Execution Control Configuration Database. Once this is available, a Processing Block Controller (Celery Worker) can be started.
For the Redis Databasem a standard redis container can be started (eg. using
the official redis:5.0.1-alpine
image). The Processing Block Controller Celery worker can be started using
the image skasip/processing_block_controller
.
A Docker Compose file (docker-compose.dev.yml
) is provided in this folder
for starting a Redis instance and a PBC Celery worker. This can be used with
the following command:
docker stack deploy -c docker-compose.dev.yml pbc
Typical usage
Note: Requires a Celery Worker, Celery Broker, and a SKA SIP Execution Control Configuration Database instance are running (see above)!
# coding: utf-8
"""Example SIP PBC usage."""
import sip_pbc
# Get the PBC version.
result = sip_pbc.version.delay()
version = result.get(timeout=1)
print(version)
# Execute a PB workflow.
result = sip_pbc.execute_processing_block.delay(pb_id='...')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for skasip_pbc-1.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1fe43c5cb5401c62d38e97b8bb566239368be2b445e5d1c533e908d82adf7048 |
|
MD5 | e959f40c87e1874e7890de5624b7ae8a |
|
BLAKE2b-256 | 11a0d30aacf68082dde767b229391aff12a17d0cc7adc915d8ab2951f915113a |