Skip to main content

Upload and download files to common cloud providers like azure blob storage, s3 and more

Project description

FastCloud

Up & Download files to any cloud storage.

Simplistic unified interface for uploading and downloading files to the cloud.

Supports

  • Azure Blob Storage :white_check_mark:
  • S3 Storages (Amazon, ...) :question:

Installation

Install via pypi with:

# to support all cloud providers
pip install fastcloud[full]
# only support azure blob storage
pip install fastcloud[azure]
# only support s3
pip install fastcloud[s3]

Or check-out the repository and work from there.

Usage

Init storage (Azure blob, S3 ...)

To directly up and download files to the cloud storage provider, you can use the following code snippets.

from fastcloud import AzureBlobStorage, S3Storage, create_cloud_storage
# Create container of your choice
cloud_store = AzureBlobStorage(connection_string="DefaultEndpointsProtocol=https;AccountName=...;AccountKey=...;EndpointSuffix=...")
cloud_store = S3Storage(access_key_id, secret_access_key, region_name)
# Or use the factory to be more flexible
cloud_store = create_cloud_storage(... your credentials ...)

Recommendation: Use environment variables to store the cloud storage access tokens / credentials.

Upload and download files

Option 1: Just with plain bytes io

# upload. Will create a file in the cloud with the name my_file
file_url = cloud_store.upload(file="path/to/file", file_name="my_file", folder="my_upload_dir")
# download. Will download the file and save it to the save-path
cloud_store.download(file_id, save_path="path/to/save")

Option 2: with media-toolkit. Media-toolkit provides easy to use classes for images, videos, audio files.

from media_toolkit import ImageFile
# upload
my_img = ImageFile.from_np_array(my_cv2_img)
file_url = cloud_store.upload(file=my_img)
# download and parse as media_file
media_file = cloud_store.download(file_url)

Tutorials

How to setup Azure Blob Storage and get connection string?

  1. Go to portal.azure.com and login.
  2. Create a storage account of your choice (choose Blob Storage option)
  3. Navigate to storage account, click on containers and add container
  4. Go back to your storage account. Click on Access keys and copy the connection string.
  5. Add the connection string to your environment variables.

Contribute

Test and implement S3 features.

Missing a cloud provider?

  • Just implement the missing class in core/providers with inheritance of the interface i_cloud_storage and make a pull request

Missing a feature?

  • Feel free to raise an issue. Better tough: just implement it and make a PR.

Also have a look at media-toolkit, FastTaskAPI for your personal cloud solution.

SUPPORT SOCAITY BY LEAVING A STAR

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fastcloud-0.0.6.tar.gz (12.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fastcloud-0.0.6-py3-none-any.whl (16.7 kB view details)

Uploaded Python 3

File details

Details for the file fastcloud-0.0.6.tar.gz.

File metadata

  • Download URL: fastcloud-0.0.6.tar.gz
  • Upload date:
  • Size: 12.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.11

File hashes

Hashes for fastcloud-0.0.6.tar.gz
Algorithm Hash digest
SHA256 aa7f27d50be6df3f911ba3a2d88b93c7589dc54a55fdae6df0bc4c7206baabe7
MD5 a1111eda6613f1df649967ffe18058ba
BLAKE2b-256 c09d362fd9c4672311e38ac6349615fd64b8f0296e65e7f81c1f6baa173114b9

See more details on using hashes here.

File details

Details for the file fastcloud-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: fastcloud-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 16.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.11

File hashes

Hashes for fastcloud-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 2efb633f88d4a477287b74b2a1a8b690a296ac3b1d1bd1a33a0fe4845550f4e8
MD5 a9dafb32be7cf27afc12f6f4509f49f8
BLAKE2b-256 66615e0e0b9c4f4efd44f19077177ad4662140261080ca3c3d93558f82e147f9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page