reana-commons 0.7.0.dev20200203

About

REANA-Commons is a component of the REANA reusable and reproducible research data analysis platform. It provides common utilities and schemas shared by the REANA cluster components.

Features

• common API clients for internal communication

• centralised OpenAPI specifications for REANA components

• AMQP connection management and communication

• utility functions for cluster components

Useful links

• documentation

• releases

• known issues

• source code

For more information about the REANA reusable analysis platform, please see the REANA project home page and the general REANA documentation pages.

Version 0.6.0 (2019-12-20)

• Adds new API for Gitlab integration.

• Adds new Kubernetes client API for ingresses.

• Adds new APIs for management of user secrets.

• Adds EOS storage Kubernetes configuration.

• Adds HTCondor and Slurm compute backends.

• Adds support for streaming file uploads.

• Allows unpacked CVMFS and CMS open data volumes.

• Adds Serial workflow step name and compute backend.

• Adds support for Python 3.8.

Version 0.5.0 (2019-04-16)

• Centralises log level and log format configuration.

• Adds new utility to inspect the disk usage on a given workspace. (get_workspace_disk_usage)

• Introduces the module to share Celery tasks accross REANA components. (tasks.py)

• Introduces common Celery task to determine whether REANA can execute new workflows depending on a set of conditions such as running job count. (reana_ready, check_predefined_conditions, check_running_job_count)

• Allows the AMQP consumer to be configurable with multiple queues.

• Introduces new queue for workflow submission. (workflow-submission)

• Introduces new publisher for workflow submissions. (WorkflowSubmissionPublisher)

• Centralises Kubernetes API client configuration and initialisation.

• Adds Kubernetes specific configuration for CVMFS volumes as utils.

• Introduces a new method, copy_openapi_specs, to automatically move validated OpenAPI specifications from components to REANA Commons openapi_specifications directory.

• Centralises interactive session types.

• Introduces central REANA errors through the errors.py module.

• Skips SSL verification for all HTTPS requests performed with the BaseAPIClient.

Version 0.4.0 (2018-11-06)

• Aggregates OpenAPI specifications of REANA components.

• Improves AMQP re-connection handling. Switches from pika to kombu.

• Enhances test suite and increases code coverage.

• Changes license to MIT.

Version 0.3.1 (2018-09-04)

• Adds parameter expansion and validation utilities for parametrised Serial workflows.

Version 0.3.0 (2018-08-10)

• Initial public release.

• Provides basic AMQP pub/sub methods for REANA components.

• Utilities for caching used in different REANA components.

• Click formatting helpers.