A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Project description
# dtest
[![CircleCI](https://circleci.com/gh/sjensen85/dtest/tree/master.svg?style=svg)](https://circleci.com/gh/sjensen85/dtest/tree/master)
[![Requirements Status](https://requires.io/github/sjensen85/dtest/requirements.svg?branch=master)](https://requires.io/github/sjensen85/dtest/requirements/?branch=master)
A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Supported messaging queues / streaming platforms
- [x] RabbitMQ
- [ ] MQTT
- [ ] Redis
- [ ] Kafka
- [ ] Kinesis
## Installation
`pip3 install dtest-framework`
## Unit Tests
Testing is set up using Pytest
Install Pytest with `pip3 install -U pytest`
Run the tests with `pytest` in the root directory.
## Circle CI
There is a `.circleci/config.yml` file that will execute the build and the unit tests against Python 3.6.
## Quick Start
```
from dtest.dtest import Dtest
from hamcrest import *
connectionConfig = {
"host": "localhost",
"username": "guest", # Can be set to None to bypass authentication
"password": "guest", # Can be set to None to bypass authentication
"exchange": "test.dtest",
"exchange_type": "fanout"
}
metadata = {
"description": "This is a test of the assertCondition",
"topic": "test.dtest",
"ruleSet": "Testing some random data",
"dataSet": "random_data_set_123912731.csv"
}
dt = Dtest(connectionConfig, metadata)
dsQubert = [0,1]
dt.assert_that(dsQubert, has_length(2))
// True
dt.publish()
// Publishes test suite to MQ server
```
[![CircleCI](https://circleci.com/gh/sjensen85/dtest/tree/master.svg?style=svg)](https://circleci.com/gh/sjensen85/dtest/tree/master)
[![Requirements Status](https://requires.io/github/sjensen85/dtest/requirements.svg?branch=master)](https://requires.io/github/sjensen85/dtest/requirements/?branch=master)
A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Supported messaging queues / streaming platforms
- [x] RabbitMQ
- [ ] MQTT
- [ ] Redis
- [ ] Kafka
- [ ] Kinesis
## Installation
`pip3 install dtest-framework`
## Unit Tests
Testing is set up using Pytest
Install Pytest with `pip3 install -U pytest`
Run the tests with `pytest` in the root directory.
## Circle CI
There is a `.circleci/config.yml` file that will execute the build and the unit tests against Python 3.6.
## Quick Start
```
from dtest.dtest import Dtest
from hamcrest import *
connectionConfig = {
"host": "localhost",
"username": "guest", # Can be set to None to bypass authentication
"password": "guest", # Can be set to None to bypass authentication
"exchange": "test.dtest",
"exchange_type": "fanout"
}
metadata = {
"description": "This is a test of the assertCondition",
"topic": "test.dtest",
"ruleSet": "Testing some random data",
"dataSet": "random_data_set_123912731.csv"
}
dt = Dtest(connectionConfig, metadata)
dsQubert = [0,1]
dt.assert_that(dsQubert, has_length(2))
// True
dt.publish()
// Publishes test suite to MQ server
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dtest-framework-0.1.10.tar.gz
(5.4 kB
view hashes)
Built Distribution
Close
Hashes for dtest_framework-0.1.10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0da8af02de16e725c7e2c8b4e88f72cad2a25492def07bc105294e5788eb57e |
|
MD5 | 3e5982d1c992bd487faa9cf68cde9897 |
|
BLAKE2b-256 | c43029cb47f38ef828d61e1055d7a63b739efcc80ee22f3c7bbb39a772c699f4 |