Skip to main content

S3 utils

Project description

s3utils

This module defines common utilities for managing S3 buckets.


init(self, region_name, aws_access_key_id, aws_secret_access_key, download_file_extension_filter=[], upload_file_extension_filter=[])

@description
    Initializes the S3Client object and creates a S3 client object.

@arguments
    region_name : <str> Supplies the region name of the S3 instance.

    aws_access_key_id : <str> Supplies the AWS access key id.

    aws_secret_access_key : <str> Supplies the AWS secret access key.

    download_file_extension_filter : <list> [optional, default=[]] Supplies the file extensions
        to download. If set to [], all files will be downloaded.

    upload_file_extension_filter : <list> [optional, default=[]] Supplies the file extensions
        to upload. If set to [], all files will be uploaded.

s3_list_folder(self, bucket, s3_folder=None)

@description
    Lists all files and sub-folders of the given folder.

@arguments
    bucket : <str> Supplies the bucket name.

    s3_folder : <str> [optional, default=None] Supplies the folder name to list under.
        If set to None, the top-level content under the given bucket will be listed.

@returns
    <list>, <list>: Returns a list contains the name of the files under the given
        folder, and a list contains the name of the sub-folders under the given folder.

s3_upload_file(self, bucket, local_file_location, s3_folder=None)

@description
    Upload a file to the given folder under the given S3 bucket.

@arguments
    bucket : <str> Supplies the bucket name.

    local_file_location : <str> Supplies the location of the file to upload.

    s3_folder : <str> [optional, default=None] Supplies the folder name to upload to.
        If set to None, the file will be uploaded under the bucket.

@returns
    None.

s3_upload_folder(self, bucket, s3_base_folder, local_folder_location)

@description
    Upload a folder to the given folder under the given S3 bucket.

@arguments
    bucket : <str> Supplies the bucket name.

    s3_base_folder : <str> Supplies the base folder on S3 to upload to.

    local_folder_location : <str> Supplies the location of the folder to upload.

@returns
    None.

s3_download_file(self, bucket, s3_file_name, download_to_folder_location)

@description
    Download the file from S3 to the given location.

@arguments
    bucket : <str> Supplies the bucket name.

    s3_file_name : <str> Supplies the name of the file on S3 to download.

    download_to_folder_location : <str> Supplies the folder to download to.

@returns
    None.

s3_download_folder(self, bucket, s3_folder, download_to_folder_location)

@description
    Download the files in the given folder from S3 to the given location.

@arguments
    bucket : <str> Supplies the bucket name.

    s3_folder : <str> Supplies the name of the folder on S3 to download.

    download_to_folder_location : <str> Supplies the folder to download to.

@returns
    None.

s3_delete_by_key(self, bucket, s3_folder=None, key=None)

@description
    Delete all files from the given bucket starting at the given folder that
    match the given key.

@arguments
    bucket : <str> Supplies the bucket name.

    s3_folder : <str> [optional, default=None] Supplies the name of the folder
        on S3 to start deleting. If set to None, deletion will start at the bucket.

    key : <str> [optional, default=None] Supplies the key to delete. If set to
        None, all files will be deleted.

@returns
    None.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ddls3utils-0.0.7.tar.gz (3.2 kB view details)

Uploaded Source

File details

Details for the file ddls3utils-0.0.7.tar.gz.

File metadata

  • Download URL: ddls3utils-0.0.7.tar.gz
  • Upload date:
  • Size: 3.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.7.3 requests-toolbelt/0.9.1 tqdm/4.30.0 CPython/3.7.0

File hashes

Hashes for ddls3utils-0.0.7.tar.gz
Algorithm Hash digest
SHA256 d3a014520ddfc9b54e9c1a7d77435efa539b85d6fe7f5962867b98c44c7505a6
MD5 548645b3bbe1cacbd19f078474e08ed2
BLAKE2b-256 25ad795d006746b2ecadc3f0c2efd6f1ee7a9190b4e42478931f80a743697cb1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page