Skip to main content

Populate and Validate the System using YAML

Project description

Satellite-Populate Documentation Status Updates

Populate and Validate the System using YAML


To install latest released version:

pip install satellite-populate

To install from github master branch:

pip install

For development:

# fork to YOUR_GITHUB
# clone your repo locally
git clone
cd satellite-populate

# add upstream remote
git remote add upstream

# create a virtualenv
mkvirtualenv satellite-populate
workon satellite-populate

# install for development (editable)
pip install -r requirements.txt

Testing if installation is good:

$ satellite-populate --test
satellite_populate.base - INFO - ECHO: Hello, if you can see this it means that I am working!!!


YAML based actions

Data population definition goes to YAML file e.g office.yaml in the following example we are going to create 2 organizations and 2 admin users using lists:


    - Dunder Mifflin
    - Wernham Hogg

    - firstname: Michael
      lastname: Scott

    - firstname: David
      lastname: Brent


  - model: Organization
    with_items: org_names
    register: default_orgs
      name: "{{ item }}"
      label: org{{ item.replace(' ', '') }}
      description: This is a satellite organization named {{ item }}

  - model: User
    with_items: user_list
      admin: true
      firstname: "{{ item.firstname }}"
      lastname: "{{ item.lastname }}"
      login: "{{ '{0}{1}'.format(item.firstname[0], item.lastname) | lower }}"
        from_factory: alpha
        from_registry: default_orgs
        from_registry: default_orgs[loop_index]

On the populate file you can define CRUD actions such as create, delete, update if action: is not defined, the default will be create.

And also there is special actions and custom actions explained later.

Populate Satellite With Entities

Considering office.yaml file above you can populate satellite system with the command line:

$ satellite-populate office.yaml -h --output=office.yaml -v

In the above command line -h stands for --hostname, --output is the output file which will be written to be used to validate the system, and -v is the verbose level.

To see the list of available arguments please run:

# satellite-populate --help

Validate if system have entities

Once you run satellite-populate you can use the outputted file to validate the system. as all the output files are named as validation_<name>.yaml in office example you can run:

$ satellite-populate validation_office.yaml -v

Using that validation file the system will be checked for entities existence, read-only. The Validation file exists because during the population dynamic data is generated such as passwords and strings from_factory and also some entities can be deleted or updated so validation file takes care of it.

Special actions

Some builtin special actions are:

  • assertion

  • echo

  • register

  • unregister

In the following example we are going to run a complete test case using actions defined in YAML file, if validation fails system returns status 0 which can be used to automate tests:

# Create a plain vanilla activation key
# Check that activation key is created and its "unlimited_hosts"
# attribute defaults to true

- action: create
  log: Create a plain vanilla activation key
  model: ActivationKey
  register: vanilla_key
     name: vanilla
       from_registry: default_orgs[0]

- action: assertion
  log: >
    Check that activation key is created and its "unlimited_hosts"
    attribute defaults to true
  operation: eq
  register: vanilla_key_unlimited_hosts
    - from_registry: vanilla_key.unlimited_hosts
    - true

- action: echo
  log: Vanilla Key Unlimited Host is False!!!!
  level: error
  print: true
  when: vanilla_key_unlimited_hosts == False

- action: echo
  log: Vanilla Key Unlimited Host is True!!!!
  level: info
  print: true
  when: vanilla_key_unlimited_hosts

- action: register
    you_must_update_vanilla_key: true
  when: vanilla_key_unlimited_hosts == False

Custom actions

And you can also have special actions defined in a custom populator.

Lets say you have this python module in your project, properly available on PYTHONPATH:

from satellite_populate.api import APIPopulator

class MyPopulator(APIPopulator):
    def action_writeinfile(self, rendered_data, action_data):
        with open(rendered_data['path'], 'w') as output:

Now go to your test.yaml and write:

  populator: mine
      module: mypath.mymodule.MyPopulator


  - action: writeinfile
    path: /tmp/test.txt
    text: Hello World!!!

and run:

$ satellite-populate test.yaml -v

Decorator for test cases

Having a data_file like:

  - model: Organization
    register: organization_1
      name: My Org

Then you can use in decorators:

def test_case_(self):
    'My Org exists in system test anything here'

And getting the populated entities inside the test_case:

@populate_with('file.yaml', context_name='my_context')
def test_case_(self, my_context=None):
    assert == 'My Org'

You can also set a customized context wrapper to the
context_wrapper argument::

    def my_custom_context_wrapper(result):
        # create an object using result
        my_context = MyResultContext(result)
        return my_context

    @populate_with('file.yaml', context_name='my_context',
    def test_case_(self, my_context=None):
        # assert with some expression using my_context object returned
        # my_custom_context_wrapper
        assert some_expression


That is important that ``context`` argument always be declared using
either a default value ``my_context=None`` or handle in ``**kwargs``
Otherwise ``py.test`` may try to use this as a fixture placeholder.

if context_wrapper is set to None, my_context will be the pure unmodified
result of populate function.

Satellite versions

This code is by default prepared to run against Satellite latest version which means the use of the latest master from nailgun repository.

If you need to run this tool in older versions e.g: to tun upgrade tests, you have to setup nailgun version.

You have 2 options:


before installing satellite-populate install specific nailgun version as the following list.

  • Satellite 6.1.x:

    pip install -e git+
    pip install satellite-populate
  • Satellite 6.2.x:

    pip install -e git+
    pip install satellite-populate
  • Satellite 6.3.x (latest):

    pip install -e git+
    pip install satellite-populate


If you need to run satellite-populate in older Satellite versions you can use the docker images so it will manage the correct nailgun version to be used with that specific system version.

First pull image from Docker Hub:

docker pull satelliteqe/satellite-populate:latest

Change :latest to specific tag. e.g: :6.1 or :6.2

Test it:

docker run satelliteqe/satellite-populate --test

Then run:

docker run -v $PWD:/datafiles satelliteqe/satellite-populate /datafiles/theoffice.yaml -v -h

You must map your local folder containing datafiles


This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.


0.1.3 (2017-01-13)

  • Docker support

0.1.2 (2017-01-12)

  • Fix decorators.

0.1.0 (2017-01-10)

  • First release on PyPI.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

satellite_populate-0.1.3.tar.gz (36.2 kB view hashes)

Uploaded source

Built Distribution

satellite_populate-0.1.3-py2.py3-none-any.whl (26.9 kB view hashes)

Uploaded py2 py3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page