Skip to main content

Access resources on Amazon S3 as a File Object.

Project description

About

s3io is a minimalistic python module which provides file object access to data on S3.

All data manipulations are done via temporary local files - so you will actually work with local temp file which is a file object with all its methods supported.

Just keep in mind these facts:

  1. Reading: the whole file will be downloaded to local temporary location at entering the context.

  2. Writing: temp file will be provided at entering the context. Actual saving to S3 will be performed at exit from context. Thus such methods as flush will not influence the process of saving to S3.

Dependencies

Examples

s3io is intended to be used via context manager only.

There are three ways to provide access to s3:

  1. Directly providing s3_connection.

  2. Providing credentials: aws_access_key_id and aws_secret_access_key.

  3. Providing profile_name. This method is recommended to use. See boto docs for more info.

Reading file using existing S3 connection:

import s3io

s3 = boto.connect_s3()
with s3io.open('s3://<bucket>/<key>', s3_connection=s3) as s3_file:
    contents = s3_file.read()

Reading file using credentials:

credentials = dict(
    aws_access_key_id='<ACCESS_KEY>',
    aws_secret_access_key='<SECRET_KEY>',
)
with s3io.open('s3://<bucket>/<key>', **credentials) as s3_file:
    contents = s3_file.read()

Reading file using profile:

with s3io.open('s3://<bucket>/<key>', profile_name='<profile>') as s3_file:
    contents = s3_file.read()

Writing file using profile:

with s3io.open('s3://<bucket>/<key>', mode='w', profile_name='<profile>') as s3_file:
    s3_file.write('Some data.')

Exceptions

Possible exceptions:

  1. s3io.BucketNotFoundError

  2. s3io.KeyNotFoundError

  3. s3io.UrlParseError

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s3io-0.1.1.tar.gz (3.0 kB view details)

Uploaded Source

File details

Details for the file s3io-0.1.1.tar.gz.

File metadata

  • Download URL: s3io-0.1.1.tar.gz
  • Upload date:
  • Size: 3.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for s3io-0.1.1.tar.gz
Algorithm Hash digest
SHA256 b80687a7f448855fe76e2089d39df293bf810a4274882688e36237a22d148c71
MD5 e78a222cdc51c57df0925baf6fad8fa0
BLAKE2b-256 534d1787b26b76c5a01525e07626a64b3a77b8c77cd275e8cfd56e0d9ae97dd5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page