Skip to main content

Consistency plugin for Dynamo Dynamic Data Management System

Project description

build-status

Dynamo Consistency is the consistency plugin for Dynamo Dynamic Data Management System. It provides some standalone executables to run the check as well as manipulate the sites’ running and reporting statuses.

The package also includes a number of modules that can be imported independently to create custom consistency checks. A simple consistency check on a site can be done by doing the following when an instance of dynamo is installed:

from dynamo_consistency import config, datatypes, remotelister, inventorylister

config.LOCATION = '/path/to/config.json'
site = 'T2_US_MIT'     # For example

inventory_listing = inventorylister.listing(site)
remote_listing = remotelister.listing(site)

datatypes.compare(inventory_listing, remote_listing, 'results')

In this example, the list of file LFNs in the inventory and not at the site will be in results_missing.txt. The list of file LFNs at the site and not in the inventory will be in results_orphan.txt. The listing functions can be reimplemented to preform the check desired.

Installation

Dynamo Consistency requires modules htcondor and XRootD to be installed separately. In addition, it uses the Dynamo Dynamic Data Management package to get inventory listings and to report results of the consistency check. Any other needed packages are installed with Dynamo Consistency during installation.

The simplest way to install is through pip:

pip install dynamo-consistency

The source code is maintained on GitHub. Other typical setuptools methods are supported by the repository’s setup.py.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
dynamo-consistency-2.7.6.tar.gz (65.3 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page