Helper for deployment and CI scripts
Project description
NWON Deployment
This package provides some basic functionality that we are using for our deployment scripts and CIs.
Package is meant for internal use at NWON as breaking changes may occur on version changes. This may change at some point but not for now 😇.
What we offer
This package can help you:
- execute shell commands
- handle dependant environments in a docker compose based deployment
- docker commands
- different deployment strategy for updating a service
- setting files handling
Command execution
We offer functions for easily execute a shell command either locally or on a docker container that is attached to one of your defined services.
Running docker commands
We offer a bunch of function that makes it easy to interact with you docker stack through docker compose or docker commands.
There are also some functions that basically wrap functionalities from the official docker package and ads our logging and some typing.
On top you get functions that wait for a specific health or container status.
Environment handling
We assume that you have a folder which has folders with the names of all of your deployment environments. In the settings you can also define a function which defines a parent environment. For example it makes some sense to have a staging environment that is basically a copy of the production environments.
Here we offer some very simple helper to get the folder for the current environment and base environment.
Zero downtime deployment
We offer a bunch of functions updating a running docker stack either by simply starting or restarting or by performing a more sophisticated zero downtime update. You can also define post start executions for each defined service. For example migrating the database after updating an api service.
Setting file handling
Every environment needs settings. We handle those in toml files living on the environment directories. There is one base file that and should be checked into version control and potentially a local override file that should not be checked in.
We handle the creation of those override files and also the loading of the settings and validating them against the provided schema.
For facilitating working with the toml files we offer functions that will create json schema files for both of these setting files in the base of you deployment scripts folder. Another function will then add the schema comment to the toml files. And 💣 boom you have autocomplete in your setting files when your editor can handle schemas for toml files.
How to use
The package is configured via a setting object. You should set this settings in your deployment scripts before using any of the tools this package provides.
Typically this happens in the top level __init__.py
file.
from nwon_deployment.settings import set_deployment_package_settings
from nwon_deployment.typings.deployment_settings import (
DeploymentSettings,
DeploymentSettingsApplicationSettings,
DeploymentSettingsDocker,
DeploymentSettingsGitlab,
DeploymentSettingsPaths,
)
settings = DeploymentSettings(
deployment_environment=deployment_environment,
deployment_base_environment=deployment_base_environment,
gitlab=DeploymentSettingsGitlab(
gitlab_registry_url="https://registry.gitlab.com/test",
use_gitlab_container_registry=False,
),
docker=DeploymentSettingsDocker(
stack_name="test",
container_name=container_name,
user_for_container={
DockerService.Api: "test",
},
default_command_for_container={DockerService.Api: "zsh"},
env_variable_map=env_variables_map_callable,
compose_files=docker_compose_files,
),
application_settings=DeploymentSettingsApplicationSettings(
settings=Settings,
lines_to_prepend_to_settings_override=["Some","thing"],
lines_to_prepend_to_settings=["Some","other","thing"],
),
paths=DeploymentSettingsPaths(
deployment_scripts_base="/Some/path",
deployment_environment="/Some/other/path",
),
)
set_deployment_package_settings(settings)
Working on the package
We recommend developing using poetry.
This are the steps to setup the project with a local virtual environment:
- Tell poetry to create dependencies in a
.venv
folder withing the project:poetry config virtualenvs.in-project true
- Create a virtual environment using the local python version:
poetry env use $(cat .python-version)
- Install dependencies:
poetry install
Prepare Package
Publishing the package it is not as straight forward as just calling poetry build
😥.
We need to:
- Clean dist folder
- Bump up the version of the package
- Build the package
Luckily we provide a script for doing all of this python scripts/prepare.py patch
. Alternatively you can run the script in a poetry context poetry run prepare patch
. The argument at the end defines whether you want a patch
, minor
or major
version bump.
The final zipped data ends up in the dist
folder.
Publish Package
Before publishing the package we need to:
- Add test PyPi repository:
poetry config repositories.testpypi https://test.pypi.org/legacy/
- Publish the package to the test repository:
poetry publish -r testpypi
- Test package:
pip install --index-url https://test.pypi.org/simple/ nwon_baseline
If everything works fine publish the package via poetry publish
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for nwon_deployment-0.1.17-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c52bc29bab7fe7355758b42e00e5a82cb184342e56f946738c720c90b504d59 |
|
MD5 | fba8cf9479bb218e82cdc4e0a23582e5 |
|
BLAKE2b-256 | 9a0bee9ca69eeb0b47b852f0494be67575d5a05e6d400d5d0dabd73bf5552296 |