Skip to main content

Seamless A/B testing with Abby.

Project description

abby

A/B testing for Human

Abby is a A/B testing library package for human. Abby aims to make A/B testing as easy as ABC and accessible to anyone.

PyPI Version Build Status

Installation

$ pip install abby

Quick Start

Please note that your variant name column should be named as variant_name. Otherwise, the method will raise an error and ask you to adjust the column name accordingly.

A/B testing for continuous metric

from abby.datasets import load_dataset
from abby import compare_ttest

data = load_dataset('click_impression')

compare_ttest(data=data, variants=['control', 'experiment'], numerator='click')

A/B testing for ratio metric

from abby.datasets import load_dataset
from abby import compare_delta

data = load_dataset("click_impression")

compare_delta(
    data=data,
    variants=["control", "experiment"],
    numerator="click",
    denominator="impression",
)

A/B testing for ratio metric using bootstrap

from abby.datasets import load_dataset
from abby import compare_bootstrap_delta

data = load_dataset("click_impression")

compare_bootstrap_delta(
    data=data,
    variants=["control", "experiment"],
    numerator="click",
    denominator="impression",
    n_bootstrap=10_000,
)

A/B testing for multiple metrics

from abby.datasets import load_dataset
from abby import compare_multiple, Ratio

data = load_dataset("click_impression")

result = compare_multiple(
    data=data,
    variants=["control", "experiment"],
    metrics=["click", Ratio("click", "impression")],
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abby-0.1.0.tar.gz (12.7 kB view hashes)

Uploaded Source

Built Distribution

abby-0.1.0-py3-none-any.whl (12.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page