AWS infrastructure testing framework that supports multiple IAC tools.
Project description
B.AwsTestingFramework
A python based AWS infrastructure testing micro-framework.
It supports multiple IAC tools like AWS CDK and AWS CloudFormation.
Description
Creating infrastructure in AWS is quite hard. There are many nuances, pitfalls and "gotchas" that sometimes are awfully frustrating. Often some IAC code changes might result in some unexpected infrastructure changes. That is why the created infrastructure should have automated integration tests. This python based framework provides you basic functionality to help you write unit ant integration tests to test AWS infrastructure created via UI or via tools like AWS CDK.
The framework is based on pytest - a python based testing library. With that said, all pytest functionality and configs can be applied on this framework too.
The framework is easy to use with explicit examples for each IAC tool. Go to examples section and find which example suits you the most.
Remarks
Biomapas aims to modernise life-science industry by sharing its IT knowledge with other companies and the community. This is an open source library intended to be used by anyone. Improvements and pull requests are welcome.
Related technology
- Python 3
- Pytest
- AWS CDK
- AWS CloudFormation
Assumptions
The project assumes the following:
- You have basic-good knowledge in python programming.
- You have basic-good knowledge in AWS.
- You have basic knowledge in testing.
Useful sources
- Read more about pytest:
https://docs.pytest.org/en/latest/
Install
The project is built and uploaded to PyPi. Install it by using pip.
pip install b_aws_testing_framework
Or directly install it through source.
pip install .
Usage & Examples
The framework uses flexible credentials management. You can either set credentials in the constructor:
from b_aws_testing_framework.credentials import Credentials
Credentials(
aws_access_key_id='key',
aws_secret_access_key='secret',
region_name='region'
)
Or you can set the environment:
set AWS_ACCESS_KEY_ID=key
set AWS_SECRET_ACCESS_KEY=key
set AWS_DEFAULT_REGION=region
And then in your python program:
from b_aws_testing_framework.credentials import Credentials
Credentials()
After setting the credentials you can set a global prefix
. Global prefix
is a globally accessible peace of string that can be used when naming AWS
resources. This is extremely useful when running tests in CI/CD pipelines
where we can have more than one parallel pipeline running. To access and
manage a global prefix, import your testing manager and use these commands:
# Set a random string.
TestingManager.set_global_prefix()
# Create a resource with a unique name. E.g.
CdkStack(
scope=scope,
id=f'{TestingManager.get_global_prefix()}TestingStackId',
stack_name=f'{TestingManager.get_global_prefix()}TestingStackName'
)
See the specific examples for specific tools:
Testing
The project has tests that can be run. Note, that tests are integration tests inherently because they test how resources are created in AWS environment. Since resources are created and tested in AWS you are subject for all the applicable charges while tests are being run.
Setting environment
Before running tests set environment variables:
- AWS_ACCESS_KEY_ID
- AWS_SECRET_ACCESS_KEY
- AWS_DEFAULT_REGION
Or:
- AWS_PROFILE
- AWS_DEFAULT_REGION
Running tests
Then run tests from a root directory with pytest
python testing library.
Testing CloudFormation functionality:
pytest b_aws_testing_framework_test/tools/testing_with_cf
Testing Cloud Development Kit functionality:
pytest b_aws_testing_framework_test/tools/testing_with_cdk
Note that integration tests usually take a while to complete (from 5 to 30 minutes on average).
Contribution
Found a bug? Want to add or suggest a new feature?
Contributions of any kind are gladly welcome. You may contact us
directly, create a pull-request or an issue in github platform.
Lets modernize the world together.
Release history
0.0.21
- Add ability to specify session token.
0.0.20
- Remove root path from cdk config in the documentation.
0.0.19
- Make sure that Python path is propagated to the process.
0.0.18
- Expose global prefix in the Testing stack.
- Update example project.
- Add ability to specify root project to fix import errors.
- Updated tests.
- Update documentation.
0.0.17
- Improve documentation with better cdk project examples.
- Add an example cdk project.
- Remove test coverage.
0.0.13
- Add testing stack for more convenient CF outputs management.
- Update documentation.
- Add docstrings.
- Updates tests and conftest configuration files.
- Version bump.
0.0.12
- Add a flag to specify whether the infrastructure should be destroyed before creating a new one.
0.0.11
- Add documentation about global prefix in readme.
0.0.10
- Create a global prefix for unique resources.
0.0.9
- Create github pipelines.
- Update code.
0.0.8
- Make sure CDK deploy works both on linux based systems and windows based systems.
0.0.7
- Bug fix related to environment.
0.0.6
- Update pytest dependency version.
0.0.5
- Rethink how this framework should be used.
0.0.4
- Fix imports.
- Update examples.
0.0.3
- Rename project.
- Update gitignore and ignore idea files.
- Update MANIFEST.
- Move examples to a documentation folder.
0.0.2
- Add hyperlinks for examples.
0.0.1
- Initial build.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for b_aws_testing_framework-0.0.21.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 132adad1441c2af30295ca269a4fd4f95ef624e91766077cd32a0bfe3fa4fc8e |
|
MD5 | 45e4520a64c56423bd188b95c73ede82 |
|
BLAKE2b-256 | f2117fa7acc9ab805be59ef10c8e27f829d7b86381a5b489c610f040dfe0fe19 |
Hashes for b_aws_testing_framework-0.0.21-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 132d26bc9a90c2080defd94dd19738fc6a0be38abb861dafdddf559ab2a1e65c |
|
MD5 | a1884305f60ea370fe6c31f5ff09be77 |
|
BLAKE2b-256 | e66663ae5a06d0a23af3e9a99421bcbe74293784e1686b3081630bbc9e2b1908 |