kraken: python distributed data transfer tool.
Project description
.. image:: https://img.shields.io/pypi/v/kraken-pyds :target: https://pypi.org/project/kraken-pyds
.. image:: https://img.shields.io/pypi/pyversions/kraken-pyds :target: https://pypi.org/project/kraken-pyds
.. image:: https://img.shields.io/travis/com/yassineazzouz/kraken :target: https://travis-ci.com/yassineazzouz/kraken
.. image:: https://img.shields.io/codecov/c/github/yassineazzouz/kraken :target: https://codecov.io/gh/yassineazzouz/kraken
Kraken
Kraken is a distributed, fast, and reliable data transfer service for efficiently moving large amounts of data between different storage technologies. It uses a distributed master worker architecture, to allow very fast data transfer speed and horizontal scaling, while implementing multiple failover, recovery and data consistency checks mechanisms to ensure robustness, fault tolerance and reliability.
Kraken typical use cases include but are not limited to :
- Data migration (across storage technologies)
- Data Replication.
- Backup and Disaster recovery.
- Data life cycle management.
Features
- Distributed data transfer service.
- Support multiple storage technologies.
- Easy to setup, configurable services.
- Command line interface to submit and monitor jobs.
- Support multiple scheduling algorithms and job priority.
- Support multiple jobs placement policies across workers.
Install
::
pip install kraken-pyds
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file kraken-pyds-2.0.1.tar.gz
.
File metadata
- Download URL: kraken-pyds-2.0.1.tar.gz
- Upload date:
- Size: 64.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.8.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d767f030994fa618716c51cb1d648129c51d2bcc4299fe73254632afebc385ba |
|
MD5 | f5d389ce89bb8c9a6b3e1f2f3bc94da9 |
|
BLAKE2b-256 | 6331e07b8967cbfba87566b6751c6f85f031a4b21c0eb8a2dba6492a02042de8 |