streamsets-testenvironments 0.0.4

Spin environments for StreamSets products

This repository is home to the StreamSets Test Environments (STE). It is designed to be run as a command line program. STE provides mechanism to start and stop environments which you can use to test against. For example, a command such as ` ste start CDH_5.12.0 ` will start a 2 node clusterdock CDH 5.12.0 cluster without requiring knowledge of the specific arguments to pass to clusterdock. Similarly ` ste stop CDH_5.12.0 ` will stop the clusterdock CDH 5.12.0 cluster and do any necessary cleanup. The goal of STE is to simplify starting and stopping environments so as they can be easily used for testing or development.

Installation

Pre-requisites

• Python 3.X

• A recent version of Docker

Installation

To install STE, simply use pip (or pipenv):

$ pip3 install streamsets-testenvironments

Commands

The following are some commands you can use with STE. In the examples here, we’ll use MySQL_5.7

Start an environment:

$ ste start MySQL_5.7

Stop an environment:

$ ste stop MySQL_5.7

Dry run without starting an environment (and also running in verbose mode):

$ ste -v start --dry-run MySQL_5.7

STE general help:

$ ste -h

STE start environment help (lists available environments which can be started):

$ ste start -h

STE stop environment help (lists available environments which can be stopped):

$ ste stop -h

STE start help for an environment:

$ ste start MySQL_5.7 -h

STE stop help for an environment:

$ ste stop MySQL_5.7 -h

History

0.0.1 (2018.06.22)

• First release on PyPI.

0.0.2 (2018.06.22)

• Environment execution compatible for shebang long path’s.

0.0.3 (2018.07.11)

• Environments added for Amazon_EMR, CDH 5.14.0, CDH 5.15.0, Couchbase.

0.0.4 (2018.08.08)

• Support for extra arguments.

• Print STF usage information.

• PostgreSQL CDC environment support added.