Example

Simple example of using aioboto3 to put items into a dynamodb table

import asyncio
import aioboto3
from boto3.dynamodb.conditions import Key


async def main():
    async with aioboto3.resource('dynamodb', region_name='eu-central-1') as dynamo_resource:
        table = dynamo_resource.Table('test_table')

        await table.put_item(
            Item={'pk': 'test1', 'col1': 'some_data'}
        )

        result = await table.query(
            KeyConditionExpression=Key('pk').eq('test1')
        )

        # Example batch write
        more_items = [{'pk': 't2', 'col1': 'c1'}, \
                      {'pk': 't3', 'col1': 'c3'}]
        async with table.batch_writer() as batch:
            for item_ in more_items:
                await batch.put_item(Item=item_)

loop = asyncio.get_event_loop()
loop.run_until_complete(main())

# Outputs:
#  [{'col1': 'some_data', 'pk': 'test1'}]

Things that either dont work or have been patched

As this library literally wraps boto3, its inevitable that some things won’t magically be async.

Fixed:

• s3_client.download_file* This is performed by the s3transfer module. – Patched with get_object

• s3_client.upload_file* This is performed by the s3transfer module. – Patched with custom multipart upload

• s3_client.copy This is performed by the s3transfer module. – Patched to use get_object -> upload_fileobject

• dynamodb_resource.Table.batch_writer This now returns an async context manager which performs the same function

• Resource waiters - You can now await waiters which are part of resource objects, not just client waiters, e.g. await dynamodbtable.wait_until_exists()

• Resource object properties are normally autoloaded, now they are all co-routines and the metadata they come from will be loaded on first await and then cached thereafter.

• S3 Bucket.objects object now works and has been asyncified. Examples here - https://aioboto3.readthedocs.io/en/latest/usage.html#s3-resource-objects

Amazon S3 Client-Side Encryption

Boto3 doesn’t support AWS client-side encryption so until they do I’ve added basic support for it. Docs here CSE

CSE requires the python cryptography library so if you do pip install aioboto3[s3cse] that’ll also include cryptography.

This library currently supports client-side encryption using KMS-Managed master keys performing envelope encryption using either AES/CBC/PKCS5Padding or preferably AES/GCM/NoPadding. The files generated are compatible with the Java Encryption SDK so I will assume they are compatible with the Ruby, PHP, Go and C++ libraries as well.

Non-KMS managed keys are not yet supported but if you have use of that, raise an issue and i’ll look into it.

Documentation

Docs are here - https://aioboto3.readthedocs.io/en/latest/

Examples here - https://aioboto3.readthedocs.io/en/latest/usage.html

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template. It also makes use of the aiobotocore and boto3 libraries. All the credit goes to them, this is mainly a wrapper with some examples.

6.5.0 (2020-02-20)

• @bact fixed some typos :)

• Asyncified the S3 resource Bucket().objects API and by extension, anything else in boto3 that uses the same object structure

• Bumped aiobotocore version so that eventstreams would now work

6.4.0 (2019-06-20)

• Updated `upload_fileobj` to upload multiple parts concurrently to make best use of the available bandwidth

6.2.0 (2019-05-07)

• @inadarei Added batch writing example

• Added waiter support in resources

• Made resource object properties coroutines and lazy load data when called

6.2.0 (2019-02-27)

• Added S3 Client side encryption functionality

6.1.0 (2019-02-13)

• nvllsvm cleaned up the packaging, requirements, travis, sphinx…

• Unvendored aiobotocore

6.0.1 (2018-11-22)

• Fixed dependencies

6.0.0 (2018-11-21)

• Fixed readthedocs

• Vendored aiobotocore for later botocore version

5.0.0 (2018-10-12)

• Updated lots of dependencies

• Changed s3.upload_fileobj from using put_object to doing a multipart upload

• Created s3.copy shim that runs get_object then does multipart upload, could do with a better implementation though.

4.1.2 (2018-08-28)

• updated pypi credentials

4.1.0 (2018-08-28)

• aiobotocore dependancy bump

4.0.2 (2018-08-03)

• Dependancy bump

4.0.0 (2018-05-09)

• Dependancy bump

• Now using aiobotocore 0.8.0

• Dropped < py3.5 support

• Now using async def / await syntax

• Fixed boto3 dependancy so it only uses a boto3 version supported by aiobotocore’s max botocore dependancy

• Important, `__call__` in `AIOServiceAction` tries to yield from a coroutine in a non-coroutine, this code shouldn’t be hit anymore but I can’t guarantee that, so instead `__call__` was duplicated and awaited properly so “should” be fine. Credit goes to Arnulfo Solis for doing PR.

3.0.0 (2018-03-29)

• Dependancy bump

• Asyncified dynamodb Table Batch Writer + Tests

• Added batch writer examples

• Now using aiobotocore 0.6.0

2.2.0 (2018-01-24)

• Dependancy bump

2.1.0 (2018-01-23)

• Dependancy bump

• Fix bug where extras isn’t packaged

2.0.0 (2017-12-30)

• Patched most s3transfer functions

1.1.2 (2017-11-29)

• Fixup of lingering GPL license texts

0.1.0 (2017-09-25)

• First release on PyPI.