Skip to main content

Simplify mocking AWS access through boto3

Project description

Boto3-Mocking - Centralized Mocking of Boto3 for Testing

When testing code that accesses AWS through the boto3 library, it is often desirable to isolate the code from actual access to the AWS API. This library facilitates both that and dispatch of the service requests to mock implementations.

Install

$ pip install boto3-mocking

Usage

Engaging the Patches

Two options exist to engage the patching of boto3: permanent and contextual. To permanently patch boto3 within the process, somewhere in the testing code that precedes use of the boto3.client and boto3.resource functions, use this code:

import boto3_mocking
boto3_mocking.engage_patching()

NOTE If your mainline code constructs boto3 clients or resources when it loads, then it is critical for the test harness to engage patching before loading mainline code.

To temporarily patch boto3, use this code:

import boto3_mocking
with boto3_mocking.patching:
    ...your code accessing AWS here...

Testing for Patch Engagement

This package exposes a function to test whether patching is currently engaged. Use this in your testing code before doing something that would harm or be expensive on the actual AWS environment:

import boto3_mocking
if not boto3_mocking.patching_engaged():
    raise Exception("...")

Registering a Service Handler

Service handlers can either be registered permanently or contextually. Registration is managed through boto3_mocking.clients and boto3_mocking.resources, corresponding to boto3.client and boto3.resource. A service handler (whether for a client or a resource) is a callable that accepts arguments by keyword and returns the mock client or resource as appropriate. The handler should accept the same keywords as the client or service it substitutes. Registering a mock client does not automatically mock a corresponding resource, as the resource does not use boto3.client to construct/obtain its client object.

To permanently register a client handler for the 'cognito-idp' service, the code would look like:

import boto3_mocking
boto3_mocking.clients.register_handler('cognito-idp', MockCognitoIdpClient)

Handlers can also be contextually registered:

import boto3_mocking
with boto3_mocking.resources.handler_for('ec2', MockEC2Resource):
    ...your code accessing EC2 here...

Only one handler may be permanently registered for each service, but a contextually registered handler registration does override a permanently registered one for the same service during its context without error or warning.

Accessing Real Boto3 Functionality

boto3_mocking.clients and boto3_mocking.resources both provide a real attribute holding the original function from boto3 from before the patching is engaged. Your service handlers can make use of these functions if necessary. One example would be to redirect 'dynamodb' clients and resources to a DynamoDBLocal instance, where the actual boto3 library is still needed but needs to have certain keyword arguments (endpoint_url and use_ssl) included when the client or resource is created.

The Allowed Lists

Access to the real functionality of boto3 can be allowed service-by-service in both boto3_mocking.clients and boto3_mocking.resources via their allowed set. Just add the name of the service to boto3_mocking.clients.allowed or boto3_mocking.resources.allowed to allow those calls without a registered handler.

Access to Unhandled Services

If a service client or resource is accessed without a handler, boto3_mocking raises a boto3_mocking.UnpatchedAccess exception unless the service is in the respective allowed list.

License

This code is licensed under Apache License 2.0. Please see LICENSE for full text.

Contributing

  1. Fork it on GitHub (https://github.com/rtweeks/boto3-mocking)
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request (on GitHub)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

boto3-mocking-0.1.0.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

boto3_mocking-0.1.0-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file boto3-mocking-0.1.0.tar.gz.

File metadata

  • Download URL: boto3-mocking-0.1.0.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.9

File hashes

Hashes for boto3-mocking-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ceb05b006db31292419db32262d53b9b7b7606e799a226296fcedc1f92aff9f1
MD5 4fe5544d0bdfb15db15532c926af201f
BLAKE2b-256 634009b89d42e1f73207846572f59afbb7411418225251e93a45ce6d95a0a45a

See more details on using hashes here.

File details

Details for the file boto3_mocking-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: boto3_mocking-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.9

File hashes

Hashes for boto3_mocking-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 aba4363f13041ed11230bbcac3ada79b338564cfbc198c4a1e1a5a40ec5b6eba
MD5 671ecc1700025e72b08773abcf9e2888
BLAKE2b-256 dccaef25b0f9a94d9d7dcc33cd5027ba3992349095b9179aff58b4596e0b9609

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page