Skip to main content

Continuous Deployment toolkit.

Project description

Status Health Coverage Version License

Prudentia is a Continuous Deployment toolkit written in Python.

Mission

Prudentia’s mission is to help you to get production (or any other environment) ready in minutes instead of days, by streamlining all the actions needed to provision your architectural components.

Features

Prudentia uses Ansible as its main automation system, so it easily understands Ansible playbooks. A playbook is one of the components needed to define a Prudentia Box.

Prudentia currently offers:

  • a CLI (supporting auto-completion) used to interactively define Boxes and run operations on them
  • Here-Document format to script Prudentia environments
  • provisioning of an existing server that can be accessed trough SSH
  • management of the lifecycle of a Box that has been created through Prudentia
  • creating Boxes using one of these providers:
    • Vagrant
    • DigitalOcean
    • local
    • ssh

Currently, all features work with Python 2.6+ and 3.2+.

Prerequisites

You need at minimum:

  • Python 2.6 and pip

To install on a Linux distribution you need:

  • libffi-dev
  • libssl-dev
  • python-dev

Installation

To install Prudentia:

$ pip install prudentia

It may be necessary to have root privileges, in which case:

$ sudo pip install prudentia

To uninstall:

$ pip uninstall prudentia

Box operations

Simple providers (e.g. Local provider or SSH provider) have the following operations available:

  • register: adds a new box definition to the registry
  • unregister: removes a box from the registry
  • reconfigure: changes the definition of an existing box
  • list: lists all boxes in the registry
  • set: defines or override an Ansible extra variable
  • unset: removes an Ansible extra variable
  • vars: loads Ansible extra variables from an external .yml or .json file (overriding existing ones)
  • envset: sets the value of an environment variable
  • provision: runs tasks defined in the playbook associated with a box
  • decrypt: sets the password used to decrypt Ansible vault files
  • verbose: sets Ansible verbosity, using a value between 0 and 4

Factory providers (e.g. Vagrant provider or DigitalOcean provider) extend simple providers and add allow you to change the box life cycle:

  • create: instantiate a new instance based of the box definition
  • restart: reloads the instance
  • stop: shuts down the instance
  • destroy: kill the instance
  • phoenix: shortcut for stop -> destroy -> create -> start -> provision (citing phoenix server Martin Fowler’s article)
  • status: returns the status of the instance

Usage

CLI

We’ll show a usage example of the SSH provider bundled with Prudentia.

Make sure you have a server that you can ssh into.

$ prudentia ssh

Check what the Ssh provider can do using tab completion:

(Prudentia > Ssh)
decrypt      EOF          help         list         provision    reconfigure  register     set          unregister   unset        vars

Let’s start registering a new box:

(Prudentia > Ssh) register
Specify the playbook path:

Now Prudentia is asking for a playbook path, and this is actually an Ansible playbook.

You can use one of the samples that you can find in the examples/boxes directory. For instance, the tasks.yml that will run some Ansible tasks that we’ve defined (those tasks are not that meaningful, but they are used as a sanity check in our tests).

So let’s continue using the tasks.yml:

(Prudentia > Ssh) register
Specify the playbook path: /path/to/prudentia/examples/boxes/tasks.yml
Specify the box name [default: tasks-host]:
Specify the instance address or inventory: ip.of.your.server
Specify the remote user [default: _your_user_]:
Specify the password for the remote user [default: ssh key]:

Box example -> (/path/to/prudentia/examples/boxes/tasks.yml, tasks-host, ip.of.your.server, _your_user_) added.

You will notice that, for some questions, Prudentia gives us a suggested answer within [ ]. For instance, the suggested Box name is tasks-host. If you like the suggestion, just press enter to choose it.

So far we’ve registered a Prudentia Box that can be used to play around. If you want to check the definition again:

(Prudentia > Ssh) list
example -> (/path/to/prudentia/examples/boxes/tasks.yml, tasks-host, ip.of.your.server, _your_user_)

Now that we have double-checked that our Box has been registered, we can provision it:

(Prudentia > Ssh) provision example

PLAY [tasks-host] ***************************************************************

GATHERING FACTS ***************************************************************
ok: [tasks-host]

TASK: [Uname] *****************************************************************
changed: [tasks-host] => {"changed": true, "cmd": ["uname", "-a"], "delta": "0:00:00.005527", "end": "2015-01-01 19:13:58.633534", "rc": 0, "start": "2015-01-01 19:13:58.628007", "stderr": "", "stdout": "Darwin tiziano-air 12.5.0 Darwin Kernel Version 12.5.0: Sun Sep 29 13:33:47 PDT 2013; root:xnu-2050.48.12~1/RELEASE_X86_64 x86_64", "warnings": []}

TASK: [Shuffle] ***************************************************************
ok: [tasks-host] => (item=2) => {
    "item": 2,
    "msg": "2"
}
ok: [tasks-host] => (item=4) => {
    "item": 4,
    "msg": "4"
}
ok: [tasks-host] => (item=1) => {
    "item": 1,
    "msg": "1"
}
ok: [tasks-host] => (item=5) => {
    "item": 5,
    "msg": "5"
}
ok: [tasks-host] => (item=3) => {
    "item": 3,
    "msg": "3"
}

TASK: [No operation] **********************************************************
ok: [tasks-host] => {
    "msg": "Task noop executed."
}

PLAY RECAP ********************************************************************
tasks-host                  : ok=4    changed=1    unreachable=0    failed=0

Play run took 0 minutes

Now Prudentia has done the reasonable uninteresting uname, shuffling a list of ints and noop tasks for me on the remote machine.

Here-Document

The same sequence of operations can be executed using the Here-Document input:

$ prudentia ssh <<EOF
register
/path/to/prudentia/examples/boxes/tasks.yml
tasks-host
ip.of.your.server
_your_user_

provision tasks-host

unregister tasks-host
EOF

Command arguments

If you want to run few commands that don’t require specific inputs then there is an option that is quicker than using the CLI or the Here-Document.

Let’s for example have a look at an example right away:

$ prudentia ssh 'decrypt' 'vars ./encrypted-vars.yml' 'provision box-name'

After running this command we will be asked to input the Ansible vault password, after that an encrypted file containing variables will be loaded (we assume that the provided password can correctly decrypt the file) and eventually provision an existing registered ssh box.

Development

You can debug and extend Prudentia (or run the latest develop) simply by sym-linking a bash script that we provided:

$ sudo ln -s prudentia.sh /usr/bin/prudentia-dev
$ prudentia-dev

In this way you can have both versions, stable and development, running on your system. The development version will run in a python virtual environment without interfering with the dependencies of the stable version. The only information that will be shared are the boxes definition.

More

Posts

Here you can find a guide on how to use Prudentia to provision a Digital Ocean droplet with the StarterSquad website on it.

Another important source of information is Iwein’s post that gives you an idea of what Continuous Delivery is, and where Prudentia fits into the flow.

Questions & Contributions

Questions, Contributions and Feedback are more than welcome.

You can checkout planned new features on the Trello Board. Feel free to create feature requests on github issues.

You can e-mail me at:

tiziano@startersquad.com

Release History

0.14 (2015-09-04)

Improvements

  • Accepts now external inventory file, directory and script as alternative for the box address.
  • Adds envset CLI action that can be used to define system environment variables.
  • Disables Ansible verbose output and introduces verbose CLI action to explicit increase verbosity.
  • Loads automatically vars/global.yml avoiding the need from now on to specify it in every playbook.
  • Adds bundled tasks: sysdig, haproxy.

Bugfixes

  • Fixes Digital Ocean droplet creation.
0.13 (2015-08-18)

Improvements

  • Enable support for multiple base images on the Vagrant provider.
  • List available base images when registering Vagrant box.
  • Adds bundled tasks: vsftpd, mailhog, monit.
  • Upgrades vault bundled task to 0.2
  • Introduces retries mechanism when asking the user to provide a valid path.

Bugfixes

  • Makes sure that Jinja2 templates do not ignore undefined variables and raise an error instead.
0.12 (2015-07-24)

Improvements

  • Makes Nginx bundled task disable the default site.
  • Shows more information about the DigitalOcean image when registering/reconfiguring a droplet.
  • Allows only the newly added sudo user to not be prompted for password.
  • Upgrades to Ansible 1.9.2.
  • Adds bundled tasks: vault (https://vaultproject.io), fail2ban, tomcat7.
  • Adds an action for the simple provider to set the password used to decrypt Ansible vault files.
  • Refactors main cli to properly parse input arguments.
  • Accepts list of commands as arguments.
  • Introduces -v (–version) argument to print current Prudentia version.
  • Adds an action for the simple provider to loads extra vars from an external .yml or .json file.
  • Checks if current version is the latest released one.
  • Accepts input paths relative to the directory where Prudentia was started or relative to the user home directory.
  • Upgrades dopy to 0.3.6 and switches to DigitalOcean API version 2 based on API token.

Bugfixes

  • Makes Nginx bundled task properly idempotent and reload the service at the end of the task.
  • Fixes ElasticSearch init script.
  • Makes sure variables value are set even if they contain spaces.
  • Waits for async bash thread to finish.
  • Fixes InsecurePlatformWarning when https connections are initiated.

Misc

  • Updates Client component example.
  • Moves build to new Travis container based infrastructure.
  • Enables properly coverage verification and improved the coverage itself.
  • Verifies support for Python 3.2+.

Documentation

  • Adds decrypt action doc.
  • Adds vars action doc.
  • Extends Usage section describing the new Commands list argument.
0.11 (2015-06-19)

Improvements

  • Suggests automatically latest Ubuntu 14.04 LTS 64bit image when creating DigitalOcean droplet.
  • Validates setting extra variables and show existing ones when running unset without arguments.
  • Updates examples.
  • Adds bundled tasks: osquery, ufw, add sudo user, zeromq, elastic search, collectd, mongodb 2.6.
  • Generalize bundled java task.
  • Upgrades to a newer version of nginx using proper apt repository.
  • Upgrades to SBT 0.13.8.

Bugfixes

  • Sets correctly the user that will run the webdriver manager.
0.10 (2015-05-12)

Improvements

  • Updates examples.
  • Upgrade to Ansible 1.9.1.

Bugfixes

  • Fixes buffering issue.
0.9.1 (2015-03-18)

Bugfixes

  • Fixes issue if cli history file doesn’t exist.
0.9 (2015-03-18)

Improvements

  • Enables cli history cross sessions.
  • Adds bundled task for adding ssh known host.
  • Adds status action for factory providers.
  • Upgrade to Ansible 1.8.4.
  • Improves examples.
  • Increases code quality.
0.8.1 (2015-02-15)

Bugfixes

  • Fixes tor bundled task.

Improvements

  • Makes postgresql and sbt parametrized tasks.
  • Improves ssh key bundled task using file module.
0.8 (2015-02-05)

Bugfixes

  • Fixes shared folder definition for Vagrant box.
  • Includes HISTORY in python setup manifest.
0.7 (2015-02-04)

Bugfixes

  • Fixes stop recreation DigitalOcean droplet when user reconfigures box without destroying it.

Improvements

  • Makes provision accept multiple tags.
  • Suggests tags during auto-completion filtering out the ones that have already been selected.
  • Enables symlinks feature in VirtualBox.
  • Registers an existing DigitalOcean droplet using the id.

Misc

  • Adds History and Authors.
0.6 (2015-01-07)

Bugfixes

  • Fix creation user dir.

Documentation

  • Described properly box operations.
0.5 (2015-01-07)

Bugfixes

  • Fixes error when running an action against a non existing box.

Improvements

  • Drops execution of the script to install Vagrant.
  • Publishes Prudentia on PyPI.
  • Adds Python 2.6 to Travis build options.
  • Refactor nodejs bundled task to use nvm (#11).
  • Hides password when user enters it during box definition (#10).
  • Executes extra checks when user inputs file paths (#8).
  • Updates Readme doc.
  • Updates and cleans up examples.
  • Creates Local Provider.
  • Adds bundled tasks: fontforge, opencv, noop, postgres, sbt, ssl-self-certificate, timezone.

Behavioral Changes

  • Restructures python packages.
  • Moves Prudentia environments directory under user home.
  • Avoids check and install Vagrant package when using Vagrant Provider.

Misc

  • Adds license.
0.4 (2014-02-09)

Bugfixes

  • Fixes several issue with Vagrantfile.
  • Fixes provisioning non existing box.

Improvements

  • Adds set/unset action used to set an environment variable.
  • Sets default for yes/no question if no answer was given.
  • Integrates Travis CI.
  • Suggest box name based on playbook hosts name.
  • Exit with error code 1 if one off cmd provisioning fails.
  • Add example box.
0.3 (2014-01-16)

Improvements

  • Creates DigitalOcean Provider and Ssh Provider.
  • Introduces Environment and Box entities.
  • Adds bundled tasks: chrome, protractor, mongodb, python.
  • Introduces bash utility.
0.2 (2013-10-15)

Bugfixes

  • Fixes provision without tags.

Improvements

  • Loads box playbook tags and use in action argument suggestion.
0.1 (2013-09-17)

Beginning

  • Adds script to install Vagrant and Ansible.
  • Creates Vagrant Provider with basic commands: add, remove, provision, phoenix, restart, destroy.
  • Adds bundled tasks: common-setup, git, github, java7, jenkins, mercurial, mysql, nginx, nodejs, redis, ruby, sbt, ssh-key, tor.
  • Provides tags support for provision action.
  • Adds shared folder to Vagrant box definition.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for prudentia, version 0.14
Filename, size File type Python version Upload date Hashes
Filename, size prudentia-0.14.tar.gz (69.3 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page