A/B experiments planning and evaluation tool
Project description
ABacus: fast hypothesis testing and experiment design solution
ABacus is a Python library developed for A/B experimentation and testing. It includes versatile instruments for different experimentation tasks like prepilot, sample size determination, results calculation, visualisations and reporting.
Important features
- Experiment design: type I and II errors, effect size, sample size simulations.
- Groups splitting with flexible configuration and stratification.
- A/A test and evaluation of splitter accuracy.
- Evaluation of experiment results with various statistical tests and approaches.
- Sensitivity increasing techniques like stratification, CUPED and CUPAC.
- Visualisation of experiment.
- Reporting in a human-readable format.
Installation
You can use pip to install ABacus directly from PyPI:
pip install kolmogorov-abacus
or right from GitHub:
pip install pip+https://github.com/kolmogorov-lab/abacus
Note the requirement of Python 3.8+.
Quick example
To define an experiment and analyse it is as easy as to describe your experiment and data:
from abacus.auto_ab.abtest import ABTest
from abacus.auto_ab.params import ABTestParams, DataParams, HypothesisParams
data_params = DataParams(...)
hypothesis_params = HypothesisParams(...)
ab_params = ABTestParams(data_params, hypothesis_params)
data = pd.read_csv('abtest_data.csv')
ab_test = ABTest(data, ab_params)
ab_test.report()
The result of code execution is the following:
Documentation and Examples
Detailed documentation and examples are available for your usage.
Communication
Authors and developers:
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file kolmogorov-abacus-0.0.6.tar.gz
.
File metadata
- Download URL: kolmogorov-abacus-0.0.6.tar.gz
- Upload date:
- Size: 31.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac0d49862fca3d5c72e342e9d801b2f80d55c205493c3712cf5f226a269270c8 |
|
MD5 | e33781bc9207e3c6d7c144260dd4f7c0 |
|
BLAKE2b-256 | 363c6c4653e08bf22284d0149bbfb04ac230206a7520a3dcf7c13d0adb4fbf71 |
File details
Details for the file kolmogorov_abacus-0.0.6-py3-none-any.whl
.
File metadata
- Download URL: kolmogorov_abacus-0.0.6-py3-none-any.whl
- Upload date:
- Size: 34.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c82ac8c4b0d963d7ad19c6b709d8f53ec85d42168fab9caf73243ed5b0cda3f5 |
|
MD5 | efb5afd0eabecde71caa83d60ce4c9ec |
|
BLAKE2b-256 | 8322d258b51db2833e4fe4a4b938bf580037458ebe5f62a84588c4925eb4e394 |