Skip to main content

A CLI tool for migrating files between cloud storage services

Project description

Cloney - Storage Migration CLI

Cloney is a lightweight command-line tool designed to migrate files between different cloud storage providers seamlessly. It supports AWS S3, Google Cloud Storage (GCS), Alibaba Cloud OSS, and Azure Blob Storage, allowing you to move data efficiently.

Features

🔄 Migrate files between S3, GCS, OSS, and Azure Blob

⚡ Fast and efficient transfer with minimal configuration

🔧 Simple CLI usage for easy automation

✅ Supports large file transfers

🔐 Secure authentication using environment variables or config files

Installation

From Source (Python)

pip install cloney

Usage

Same Cloud Transfers

Migrate data within the same cloud provider:

AWS S3 to AWS S3

cloney s3 my-source-bucket s3 my-destination-bucket

Google Cloud Storage to Google Cloud Storage

cloney gcs my-source-bucket gcs my-destination-bucket

Azure Blob Storage to Azure Blob Storage

cloney azure my-source-container azure my-destination-container

Alibaba Cloud OSS to Alibaba Cloud OSS

cloney oss my-source-bucket oss my-destination-bucket

Cross-Cloud Transfers

Migrate data between different cloud providers:

AWS S3 to Google Cloud Storage

cloney s3 my-s3-bucket gcs my-gcs-bucket

Google Cloud Storage to Azure Blob Storage

cloney gcs my-gcs-bucket azure my-azure-container

Azure Blob Storage to Alibaba Cloud OSS

cloney azure my-azure-container oss my-oss-bucket

If you would like to create the destination bucket automatically, use the --create-destination-bucket flag:

cloney s3 my-source-bucket gcs my-destination-bucket --create-destination-bucket

Authentication

Cloney supports authentication via environment variables or configuration files:

Linux/macOS

AWS S3

export AWS_ACCESS_KEY_ID=your-access-key
export AWS_SECRET_ACCESS_KEY=your-secret-key

Google Cloud Storage (GCS)

export GOOGLE_APPLICATION_CREDENTIALS=/path/to/your/gcs-key.json

Alibaba Cloud OSS

export OSS_ENDPOINT=your-endpoint
export OSS_ACCESS_KEY_ID=your-access-key
export OSS_ACCESS_KEY_SECRET=your-secret-key

Azure Blob Storage

export AZURE_STORAGE_CONNECTION_STRING="your-connection-string"

Windows (PowerShell)

AWS S3

$env:AWS_ACCESS_KEY_ID="your-access-key"
$env:AWS_SECRET_ACCESS_KEY="your-secret-key"

Google Cloud Storage (GCS)

$env:GOOGLE_APPLICATION_CREDENTIALS="C:\path\to\your\gcs-key.json"

Alibaba Cloud OSS

$env:OSS_ENDPOINT="your-endpoint"
$env:OSS_ACCESS_KEY_ID="your-access-key"
$env:OSS_ACCESS_KEY_SECRET="your-secret-key"

Azure Blob Storage

$env:AZURE_STORAGE_CONNECTION_STRING="your-connection-string"

Contributing

Contributions are welcome! Feel free to open issues or submit pull requests.

License

Cloney is licensed under the MIT License.

Contact

For questions or support, open an issue on GitHub.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cloney-0.1.2.tar.gz (7.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

cloney-0.1.2-py3-none-any.whl (7.4 kB view details)

Uploaded Python 3

File details

Details for the file cloney-0.1.2.tar.gz.

File metadata

  • Download URL: cloney-0.1.2.tar.gz
  • Upload date:
  • Size: 7.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.5

File hashes

Hashes for cloney-0.1.2.tar.gz
Algorithm Hash digest
SHA256 c7050b84a0afd2dea136ebe57cf3b2e980e5598176d77e4b97ccd4e78a121fa5
MD5 87c4d1249d2a40cad474e9c0069c52f0
BLAKE2b-256 3da34826dde23ffb9348c754231314bc4163813b6b7e986cf816161c88fac246

See more details on using hashes here.

File details

Details for the file cloney-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: cloney-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 7.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.5

File hashes

Hashes for cloney-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 ae366c714d34e43d2a39d3df8a9fb8e537f0e585123f7c281053d95635c5e9e0
MD5 4a70d05cb83e192d9d28241110cd6279
BLAKE2b-256 1f5bd09a077ed07fb2f8e346e0297a597d90ad74f7908dc47d3314a28ca439d1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page