Skip to main content

A/B experiments planning and evaluation tool

Project description

Experiment report

PyPI Latest Release PyPI Downloads Telegram License - MIT License

ABacus: fast hypothesis testing and experiment design solution

ABacus is a Python library developed for A/B experimentation and testing. It includes versatile instruments for different experimentation tasks like prepilot, sample size determination, results calculation, visualisations and reporting.

Important features

  • Experiment design: type I and II errors, effect size, sample size simulations.
  • Groups splitting with flexible configuration and stratification.
  • A/A test and evaluation of splitter accuracy.
  • Evaluation of experiment results with various statistical tests and approaches.
  • Sensitivity increasing techniques like stratification, CUPED and CUPAC.
  • Visualisation of experiment.
  • Reporting in a human-readable format.

Installation

You can use pip to install ABacus directly from PyPI:

pip install kolmogorov-abacus

or right from GitHub:

pip install pip+https://github.com/kolmogorov-lab/abacus

Note the requirement of Python 3.8+.

Quick example

To define an experiment and analyse it is as easy as to describe your experiment and data:

from abacus.auto_ab.abtest import ABTest
from abacus.auto_ab.params import ABTestParams, DataParams, HypothesisParams

data_params = DataParams(...)
hypothesis_params = HypothesisParams(...)
ab_params = ABTestParams(data_params, hypothesis_params)

data = pd.read_csv('abtest_data.csv')

ab_test = ABTest(data, ab_params)

ab_test.report()

The result of code execution is the following:

Experiment report

Documentation and Examples

Detailed documentation and examples are available for your usage.

Communication

Authors and developers:

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kolmogorov-abacus-0.0.6.tar.gz (31.3 kB view details)

Uploaded Source

Built Distribution

kolmogorov_abacus-0.0.6-py3-none-any.whl (34.9 kB view details)

Uploaded Python 3

File details

Details for the file kolmogorov-abacus-0.0.6.tar.gz.

File metadata

  • Download URL: kolmogorov-abacus-0.0.6.tar.gz
  • Upload date:
  • Size: 31.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.8.18

File hashes

Hashes for kolmogorov-abacus-0.0.6.tar.gz
Algorithm Hash digest
SHA256 ac0d49862fca3d5c72e342e9d801b2f80d55c205493c3712cf5f226a269270c8
MD5 e33781bc9207e3c6d7c144260dd4f7c0
BLAKE2b-256 363c6c4653e08bf22284d0149bbfb04ac230206a7520a3dcf7c13d0adb4fbf71

See more details on using hashes here.

File details

Details for the file kolmogorov_abacus-0.0.6-py3-none-any.whl.

File metadata

File hashes

Hashes for kolmogorov_abacus-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 c82ac8c4b0d963d7ad19c6b709d8f53ec85d42168fab9caf73243ed5b0cda3f5
MD5 efb5afd0eabecde71caa83d60ce4c9ec
BLAKE2b-256 8322d258b51db2833e4fe4a4b938bf580037458ebe5f62a84588c4925eb4e394

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page