Skip to main content

Simplify mocking AWS access through boto3

Project description

Boto3-Mocking - Centralized Mocking of Boto3 for Testing

When testing code that accesses AWS through the boto3 library, it is often desirable to isolate the code from actual access to the AWS API. This library facilitates both that and dispatch of the service requests to mock implementations.

Install

$ pip install boto3-mocking

Usage

Engaging the Patches

Two options exist to engage the patching of boto3: permanent and contextual. To permanently patch boto3 within the process, somewhere in the testing code that precedes use of the boto3.client and boto3.resource functions, use this code:

import boto3_mocking
boto3_mocking.engage_patching()

NOTE If your mainline code constructs boto3 clients or resources when it loads, then it is critical for the test harness to engage patching before loading mainline code.

To temporarily patch boto3, use this code:

import boto3_mocking
with boto3_mocking.patching:
    ...your code accessing AWS here...

Testing for Patch Engagement

This package exposes a function to test whether patching is currently engaged. Use this in your testing code before doing something that would harm or be expensive on the actual AWS environment:

import boto3_mocking
if not boto3_mocking.patching_engaged():
    raise Exception("...")

Registering a Service Handler

Service handlers can either be registered permanently or contextually. Registration is managed through boto3_mocking.clients and boto3_mocking.resources, corresponding to boto3.client and boto3.resource. A service handler (whether for a client or a resource) is a callable that accepts arguments by keyword and returns the mock client or resource as appropriate. The handler should accept the same keywords as the client or service it substitutes. Registering a mock client does not automatically mock a corresponding resource, as the resource does not use boto3.client to construct/obtain its client object.

To permanently register a client handler for the 'cognito-idp' service, the code would look like:

import boto3_mocking
boto3_mocking.clients.register_handler('cognito-idp', MockCognitoIdpClient)

Handlers can also be contextually registered:

import boto3_mocking
with boto3_mocking.resources.handler_for('ec2', MockEC2Resource):
    ...your code accessing EC2 here...

Only one handler may be permanently registered for each service, but a contextually registered handler registration does override a permanently registered one for the same service during its context without error or warning.

Accessing Real Boto3 Functionality

boto3_mocking.clients and boto3_mocking.resources both provide a real attribute holding the original function from boto3 from before the patching is engaged. Your service handlers can make use of these functions if necessary. One example would be to redirect 'dynamodb' clients and resources to a DynamoDBLocal instance, where the actual boto3 library is still needed but needs to have certain keyword arguments (endpoint_url and use_ssl) included when the client or resource is created.

The Allowed Lists

Access to the real functionality of boto3 can be allowed service-by-service in both boto3_mocking.clients and boto3_mocking.resources via their allowed set. Just add the name of the service to boto3_mocking.clients.allowed or boto3_mocking.resources.allowed to allow those calls without a registered handler.

Access to Unhandled Services

If a service client or resource is accessed without a handler, boto3_mocking raises a boto3_mocking.UnpatchedAccess exception unless the service is in the respective allowed list.

License

This code is licensed under Apache License 2.0. Please see LICENSE for full text.

Contributing

  1. Fork it on GitHub (https://github.com/rtweeks/boto3-mocking)
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request (on GitHub)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

boto3-mocking-0.1.1.tar.gz (4.5 kB view details)

Uploaded Source

Built Distribution

boto3_mocking-0.1.1-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file boto3-mocking-0.1.1.tar.gz.

File metadata

  • Download URL: boto3-mocking-0.1.1.tar.gz
  • Upload date:
  • Size: 4.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.9

File hashes

Hashes for boto3-mocking-0.1.1.tar.gz
Algorithm Hash digest
SHA256 9cb509375bc59e6b62bf6bece6f64ba70b31cc05ab5c60db0deeb39bd53472c2
MD5 3a7182ce46f3173a75e08e15a5a196fc
BLAKE2b-256 46402276b345cec84586481083f65e8bd32caf7e18d05136b893858e79a2d64a

See more details on using hashes here.

File details

Details for the file boto3_mocking-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: boto3_mocking-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.7.0 requests/2.25.1 setuptools/39.0.1 requests-toolbelt/0.9.1 tqdm/4.56.2 CPython/3.6.9

File hashes

Hashes for boto3_mocking-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d0273366d3cb86c5bf3d6f31d1c6e40c11b714d49b5f2d5125234d0d59aa9378
MD5 384a50e3966a5968fc8efc78c1da7178
BLAKE2b-256 a60077a0251eaaee7b9ea9f593717d7308a7c3ce1e6f318b5dfea25e99c853e6

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page