reana-commons 0.7.0.dev20200319

REANA-Commons.

About

REANA-Commons is a component of the REANA reusable and reproducible research data analysis platform. It provides common utilities and schemas shared by the REANA cluster components.

Features

• common API clients for internal communication

• centralised OpenAPI specifications for REANA components

• AMQP connection management and communication

• utility functions for cluster components

Useful links

• documentation

• releases

• known issues

• source code

For more information about the REANA reusable analysis platform, please see the REANA project home page and the general REANA documentation pages.

Changes

Version 0.6.0 (2019-12-20)

• Adds new API for Gitlab integration.

• Adds new Kubernetes client API for ingresses.

• Adds new APIs for management of user secrets.

• Adds EOS storage Kubernetes configuration.

• Adds HTCondor and Slurm compute backends.

• Adds support for streaming file uploads.

• Allows unpacked CVMFS and CMS open data volumes.

• Adds Serial workflow step name and compute backend.

• Adds support for Python 3.8.

Version 0.5.0 (2019-04-16)

• Centralises log level and log format configuration.

• Adds new utility to inspect the disk usage on a given workspace. (get_workspace_disk_usage)

• Introduces the module to share Celery tasks accross REANA components. (tasks.py)

• Introduces common Celery task to determine whether REANA can execute new workflows depending on a set of conditions such as running job count. (reana_ready, check_predefined_conditions, check_running_job_count)

• Allows the AMQP consumer to be configurable with multiple queues.

• Introduces new queue for workflow submission. (workflow-submission)

• Introduces new publisher for workflow submissions. (WorkflowSubmissionPublisher)

• Centralises Kubernetes API client configuration and initialisation.

• Adds Kubernetes specific configuration for CVMFS volumes as utils.

• Introduces a new method, copy_openapi_specs, to automatically move validated OpenAPI specifications from components to REANA Commons openapi_specifications directory.

• Centralises interactive session types.

• Introduces central REANA errors through the errors.py module.

• Skips SSL verification for all HTTPS requests performed with the BaseAPIClient.

Version 0.4.0 (2018-11-06)

• Aggregates OpenAPI specifications of REANA components.

• Improves AMQP re-connection handling. Switches from pika to kombu.

• Enhances test suite and increases code coverage.

• Changes license to MIT.

Version 0.3.1 (2018-09-04)

• Adds parameter expansion and validation utilities for parametrised Serial workflows.

Version 0.3.0 (2018-08-10)

• Initial public release.

• Provides basic AMQP pub/sub methods for REANA components.

• Utilities for caching used in different REANA components.

• Click formatting helpers.

Please beware

Please note that REANA is in an early alpha stage of its development. The developer preview releases are meant for early adopters and testers. Please don’t rely on released versions for any production purposes yet.