A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Project description
# dtest
[![CircleCI](https://circleci.com/gh/sjensen85/dtest/tree/master.svg?style=svg)](https://circleci.com/gh/sjensen85/dtest/tree/master)
[![Requirements Status](https://requires.io/github/sjensen85/dtest/requirements.svg?branch=master)](https://requires.io/github/sjensen85/dtest/requirements/?branch=master)
A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Supported messaging queues / streaming platforms
- [x] RabbitMQ
- [ ] MQTT
- [ ] Redis
- [ ] Kafka
- [ ] Kinesis
## Installation
`pip3 install dtest-framework`
## Unit Tests
Testing is set up using Pytest
Install Pytest with `pip3 install -U pytest`
Run the tests with `pytest` in the root directory.
## Circle CI
There is a `.circleci/config.yml` file that will execute the build and the unit tests against Python 3.6.
## Quick Start
```
from dtest.dtest import Dtest
from hamcrest import *
connectionConfig = {
"host": "localhost",
"username": "guest", # Can be set to None to bypass authentication
"password": "guest", # Can be set to None to bypass authentication
"exchange": "test.dtest",
"exchange_type": "fanout"
}
metadata = {
"description": "This is a test of the assertCondition",
"topic": "test.dtest",
"ruleSet": "Testing some random data",
"dataSet": "random_data_set_123912731.csv"
}
dt = Dtest(connectionConfig, metadata)
dsQubert = [0,1]
dt.assert_that(dsQubert, has_length(2))
// True
dt.publish()
// Publishes test suite to MQ server
```
[![CircleCI](https://circleci.com/gh/sjensen85/dtest/tree/master.svg?style=svg)](https://circleci.com/gh/sjensen85/dtest/tree/master)
[![Requirements Status](https://requires.io/github/sjensen85/dtest/requirements.svg?branch=master)](https://requires.io/github/sjensen85/dtest/requirements/?branch=master)
A library to facilitate the testing of data inside data pipelines. Results are pushed to a messaging queue of some sort for consumption by applications, persistence, etc.
Supported messaging queues / streaming platforms
- [x] RabbitMQ
- [ ] MQTT
- [ ] Redis
- [ ] Kafka
- [ ] Kinesis
## Installation
`pip3 install dtest-framework`
## Unit Tests
Testing is set up using Pytest
Install Pytest with `pip3 install -U pytest`
Run the tests with `pytest` in the root directory.
## Circle CI
There is a `.circleci/config.yml` file that will execute the build and the unit tests against Python 3.6.
## Quick Start
```
from dtest.dtest import Dtest
from hamcrest import *
connectionConfig = {
"host": "localhost",
"username": "guest", # Can be set to None to bypass authentication
"password": "guest", # Can be set to None to bypass authentication
"exchange": "test.dtest",
"exchange_type": "fanout"
}
metadata = {
"description": "This is a test of the assertCondition",
"topic": "test.dtest",
"ruleSet": "Testing some random data",
"dataSet": "random_data_set_123912731.csv"
}
dt = Dtest(connectionConfig, metadata)
dsQubert = [0,1]
dt.assert_that(dsQubert, has_length(2))
// True
dt.publish()
// Publishes test suite to MQ server
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dtest-framework-0.1.12.tar.gz
(5.6 kB
view hashes)
Built Distribution
Close
Hashes for dtest_framework-0.1.12-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83a28593df49e61ca2701f05ec5ef662e9fbef202daa967e53961e749261f297 |
|
MD5 | ec45b35ae8148f9b872b432774e561d8 |
|
BLAKE2b-256 | 4563249ba70db0f0be7a86b052121f949963567b1864c984b1a09a7da98942c3 |