cloud-storage-slim 0.2.0

A lightweight cloud storage package for popular cloud storage services.

Cloud Storage Slim

Principles

• No complex operations, just focus on simple things.
• Inspired by rclone.

Installation

pip install cloud-storage-slim

Usage

from cloud_storage_slim import CloudStorageSlim

cloud_storage = CloudStorageSlim()
cloud_storage.copyto('gs://bucket1/object1', 'az://bucket2/object2')

Features

• copyto
• ls

Supported Cloud Storage

• Google Cloud Storage
• Azure Blob Storage
• AlibabaCloud / Aliyun OSS
• AWS S3

Credentials

Google Cloud Storage

• How Application Default Credentials works
• GOOGLE_APPLICATION_CREDENTIALS
• google-cloud-python

pip install google-cloud-storage

Amazon S3

• Boto3 Configuring credentials
• Using environment variables
• AWS_DEFAULT_REGION
• AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY
• AWS_SESSION_TOKEN
• Boto3

pip install boto3

Azure Blob Storage

• Manage storage account access keys
• AZURE_STORAGE_ACCOUNT_NAME, AZURE_STORAGE_ACCOUNT_KEY

pip install azure-storage-blob azure-identity

AlibabaCloud / Aliyun OSS

• Configure access credentials
• OSS_ENDPOINT
• OSS_ACCESS_KEY_ID, OSS_ACCESS_KEY_SECRET
• OSS_SESSION_TOKEN
• oss2

pip install oss2

Test cases

before run test cases, you need to prepare the test bucket.