Skip to main content

kraken: python distributed data transfer tool.

Project description

.. image:: https://img.shields.io/pypi/v/kraken-pyds :target: https://pypi.org/project/kraken-pyds

.. image:: https://img.shields.io/pypi/pyversions/kraken-pyds :target: https://pypi.org/project/kraken-pyds

.. image:: https://img.shields.io/travis/com/yassineazzouz/kraken :target: https://travis-ci.com/yassineazzouz/kraken

.. image:: https://img.shields.io/codecov/c/github/yassineazzouz/kraken :target: https://codecov.io/gh/yassineazzouz/kraken

Kraken

Kraken is a distributed, fast, and reliable data transfer service for efficiently moving large amounts of data between different storage technologies. It uses a distributed master worker architecture, to allow very fast data transfer speed and horizontal scaling, while implementing multiple failover, recovery and data consistency checks mechanisms to ensure robustness, fault tolerance and reliability.

Kraken typical use cases include but are not limited to :

  • Data migration (across storage technologies)
  • Data Replication.
  • Backup and Disaster recovery.
  • Data life cycle management.

Features

  • Distributed data transfer service.
  • Support multiple storage technologies.
  • Easy to setup, configurable services.
  • Command line interface to submit and monitor jobs.
  • Support multiple scheduling algorithms and job priority.
  • Support multiple jobs placement policies across workers.

Install

::

pip install kraken-pyds

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kraken-pyds-2.0.1.tar.gz (64.4 kB view details)

Uploaded Source

File details

Details for the file kraken-pyds-2.0.1.tar.gz.

File metadata

  • Download URL: kraken-pyds-2.0.1.tar.gz
  • Upload date:
  • Size: 64.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0 requests-toolbelt/0.9.1 tqdm/4.50.0 CPython/3.8.5

File hashes

Hashes for kraken-pyds-2.0.1.tar.gz
Algorithm Hash digest
SHA256 d767f030994fa618716c51cb1d648129c51d2bcc4299fe73254632afebc385ba
MD5 f5d389ce89bb8c9a6b3e1f2f3bc94da9
BLAKE2b-256 6331e07b8967cbfba87566b6751c6f85f031a4b21c0eb8a2dba6492a02042de8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page