A simple plugin to use with pytest
Project description
pytest-elk-reporter
A plugin to send pytest test results to ELK stack, with extra context data
Features
- Reporting into Elasticsearch each test result, as the test finish
- Automaticlly append context data to each test:
- git inforamtion such as
branch
orlast commit
and more - all of Jenkins env variables
- username if available
- git inforamtion such as
- Report a test summery to Elastic for each session with all the context data
- can append any user data into the context sent to elastic
Requirements
- having pytest tests written
Installation
You can install "pytest-elk-reporter" via pip from PyPI
pip install pytest-elk-reporter
ElasticSearch configureation
We need this auto_create_index enable for the indexes that are going to be used, since we don't have code to create the indexes, this is the default
curl -X PUT "localhost:9200/_cluster/settings" -H 'Content-Type: application/json' -d'
{
"persistent": {
"action.auto_create_index": "true"
}
}
'
For more info on this elasticsearch feature check thier index documention
Usage
Run and configure from command line
pytest --es-address 127.0.0.1:9200
# or if you need user/password to authenticate
pytest --es-address my-elk-server.io:9200 --es-username fruch --es-password 'passwordsarenicetohave'
Configure from code (Idealy in conftest.py)
import pytest
@pytest.fixture(scope='session', autouse=True)
def configure_es(elk_reporter):
# TODO: get cerdentials in more secure fashion programtically, maybe AWS secrects or the likes
# or put them in plain-text in the code... what can ever go wrong...
elk_reporter.es_address = "my-elk-server.io:9200"
elk_reporter.es_user = 'fruch'
elk_reporter.es_password = 'passwordsarenicetohave'
elk_reporter.es_index_name = 'test_data'
Configure from pytest ini file
# put this in pytest.ini / tox.ini / setup.cfg
[pytest]
es_address = my-elk-server.io:9200
es_user = fruch
es_password = passwordsarenicetohave
es_index_name = test_data
see pytest docs for more about how to configure using .ini files
Collect context data for the whole session
For example, with this I'll be able to build a dash board per version
@pytest.fixture(scope="session", autouse=True)
def report_formal_version_to_elk(request):
"""
Append my own data specific, for example which of the code uner test is used
"""
# TODO: take it programticly of of the code under test...
my_data = {"formal_version": "1.0.0-rc2" }
elk = request.config.pluginmanager.get_plugin("elk-reporter-runtime")
elk.session_data.update(**my_data)
Collect data for specific tests
def test_my_service_and_collect_timings(request, elk_reporter):
response = requests.get("http://my-server.io/api/do_something")
assert response.status_code == 200
elk_reporter.append_test_data(request, {"do_something_response_time": response.elapsed.total_seconds() })
# now doing response time per version dashboard quite easy
# and yeah, it's not exactly real usable metric, it's just an example...
Contributing
Contributions are very welcome. Tests can be run with tox
, please ensure
the coverage at least stays the same before you submit a pull request.
License
Distributed under the terms of the MIT license, "pytest-elk-reporter" is free and open source software
Issues
If you encounter any problems, please file an issue along with a detailed description.
Thanks
This pytest plugin was generated with Cookiecutter along with @hackebrot's cookiecutter-pytest-plugin template.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pytest-elk-reporter-0.1.13.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7397121cda266620f594a7af4164072d8f9805502e50bcca6bba25554877ea3 |
|
MD5 | 021e8c2701ced5ac34a7638567c9d6d5 |
|
BLAKE2b-256 | 436050db13b7394fe8bf16d0eb1a5baa357eec0b0309f09337614a93c1292b2a |
Hashes for pytest_elk_reporter-0.1.13-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61bb0ea3f66fa9f2924e22fc8d14e78fa7d3e8305a60fe21282d6f0c580ff3cc |
|
MD5 | 6047de187209dd09856a04e8b48a2c7c |
|
BLAKE2b-256 | ba0e434ba05651497b434a737b2d75482285d1e9704a177ef9966f7d9f02d957 |