Skip to main content

Tools for tools for managing federated carbon clusters.

Project description

# Carbonate Utils

Utilities to plumb carbonate tools together.
Depends on the master (and yet unreleased) branches of whisper, carbonate and carbon.

## The Tools

### carbonate-sync

```bash
$ carbonate-sync --help
usage: carbonate-sync [-h] [-c CONFIG_FILE] [-C CLUSTER] [-S REMOTE_CLUSTER]
[-n NODE] [-b BATCH_SIZE] [--ssh-options SSH_OPTIONS]
[--rsync-options RSYNC_OPTIONS] [--temp-dir TEMP_DIR]
[--exclude EXCLUDE] [--start-time START_TIME]
[--end-time END_TIME] [--overwrite OVERWRITE]

carbonate-sync

optional arguments:
-h, --help show this help message and exit
-c CONFIG_FILE, --config-file CONFIG_FILE
Config file to use (default:
/opt/graphite/conf/carbonate.conf)
-C CLUSTER, --cluster CLUSTER
Cluster name (default: main)
-S REMOTE_CLUSTER, --remote-cluster REMOTE_CLUSTER
Remote cluster name (default: None)
-n NODE, --node NODE Name of the local node (same as in carbonate.conf).
(default: coulomier)
-b BATCH_SIZE, --batch-size BATCH_SIZE
Batch size for fetching metrics. (default: 1000)
--ssh-options SSH_OPTIONS
Pass option(s) to ssh. Make sure to use "--ssh-
options=" if option starts with '-' (default: -o
StrictHostKeyChecking=no -o
UserKnownHostsFile=/dev/null -o Compression=no)
--rsync-options RSYNC_OPTIONS
Pass option(s) to rsync. Make sure to use "--rsync-
options=" if option starts with '-' (default:
--archive --sparse --update --modify-window=100800)
--temp-dir TEMP_DIR Temporary dir (default: /tmp)
--exclude EXCLUDE Comma separated regexp of paths to exclude (slow).
(default: ^carbon\.)
--start-time START_TIME
Sync data more recent than this time. (default: 0)
--end-time END_TIME Sync data older than this time (default: now).
(default: 1465420874.04)
--overwrite OVERWRITE
Overwrite local data with remote data (default:
false). (default: False)
```

# Authors

* Brice Arnould <b.arnould@criteo.com>
* Corentin Chary <c.chary@criteo.com>

# License and warnings

These tools should be considered beta quality right now.
Tests exist for most functionality, but there is still significant work to be done to make them bullet-proof.

The code is available under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

carbonate-utils-0.4.0.tar.gz (10.4 kB view details)

Uploaded Source

File details

Details for the file carbonate-utils-0.4.0.tar.gz.

File metadata

File hashes

Hashes for carbonate-utils-0.4.0.tar.gz
Algorithm Hash digest
SHA256 a5954c445ccc247a024d9cc11e633160376091ecffafc6bcb7e16fa9ac35b0e4
MD5 4855a5d43f7515082dac9426cf41474a
BLAKE2b-256 65bfe42a6477d2625af486bf1e90f3b8267b8275129eb87f1763ec6916f58346

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page