Skip to main content

Access resources on Amazon S3 as a File Object.

Project description


s3io is a minimalistic python module which provides file object access to data on S3.

All data manipulations are done via temporary local files - so you will actually work with local temp file which is a file object with all its methods supported.

Just keep in mind these facts:

  1. Reading: the whole file will be downloaded to local temporary location at entering the context.

  2. Writing: temp file will be provided at entering the context. Actual saving to S3 will be performed at exit from context. Thus such methods as flush will not influence the process of saving to S3.



s3io is intended to be used via context manager only.

There are three ways to provide access to s3:

  1. Directly providing s3_connection.

  2. Providing credentials: aws_access_key_id and aws_secret_access_key.

  3. Providing profile_name. This method is recommended to use. See boto docs for more info.

Reading file using existing S3 connection:

import s3io

s3 = boto.connect_s3()
with's3://<bucket>/<key>', s3_connection=s3) as s3_file:
    contents =

Reading file using credentials:

credentials = dict(
with's3://<bucket>/<key>', **credentials) as s3_file:
    contents =

Reading file using profile:

with's3://<bucket>/<key>', profile_name='<profile>') as s3_file:
    contents =

Writing file using profile:

with's3://<bucket>/<key>', mode='w', profile_name='<profile>') as s3_file:
    s3_file.write('Some data.')


Possible exceptions:

  1. s3io.BucketNotFoundError

  2. s3io.KeyNotFoundError

  3. s3io.UrlParseError

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s3io-0.1.1.tar.gz (3.0 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page