Seamless A/B testing with Abby.
Project description
abby
A/B testing for Human
Abby is a A/B testing library package for human. Abby aims to make A/B testing as easy as ABC and accessible to anyone.
Installation
$ pip install abby
Quick Start
Please note that your variant name column should be named as variant_name
. Otherwise, the method will raise an error and ask you to adjust the column name accordingly.
A/B testing for continuous metric
from abby.datasets import load_dataset
from abby import compare_ttest
data = load_dataset('click_impression')
compare_ttest(data=data, variants=['control', 'experiment'], numerator='click')
A/B testing for ratio metric
from abby.datasets import load_dataset
from abby import compare_delta
data = load_dataset("click_impression")
compare_delta(
data=data,
variants=["control", "experiment"],
numerator="click",
denominator="impression",
)
A/B testing for ratio metric using bootstrap
from abby.datasets import load_dataset
from abby import compare_bootstrap_delta
data = load_dataset("click_impression")
compare_bootstrap_delta(
data=data,
variants=["control", "experiment"],
numerator="click",
denominator="impression",
n_bootstrap=10_000,
)
A/B testing for multiple metrics
from abby.datasets import load_dataset
from abby import compare_multiple, Ratio
data = load_dataset("click_impression")
result = compare_multiple(
data=data,
variants=["control", "experiment"],
metrics=["click", Ratio("click", "impression")],
)
A/B/N testing for multiple metrics
from abby.datasets import load_dataset
from abby import compare_multiple, Ratio
data = load_dataset("click_impression_3_variants")
result = compare_multiple(
data=data,
variants=["control", "experiment_A", "experiment_B"],
metrics=["click", Ratio("click", "impression")],
)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
abby-0.1.2.tar.gz
(14.5 kB
view details)
Built Distribution
abby-0.1.2-py3-none-any.whl
(14.9 kB
view details)
File details
Details for the file abby-0.1.2.tar.gz
.
File metadata
- Download URL: abby-0.1.2.tar.gz
- Upload date:
- Size: 14.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: python-requests/2.28.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bdb4f7ea30416d6917dffdd4bfa9aedcc5ff565ecbf1c7f8096abed5fd58d706 |
|
MD5 | 2d4a7d25500ac693dbed4941be9de904 |
|
BLAKE2b-256 | c1b16cf2d47e457df12f13782baf79fb77dcd2fccd82d8336b3fc686572fc712 |
File details
Details for the file abby-0.1.2-py3-none-any.whl
.
File metadata
- Download URL: abby-0.1.2-py3-none-any.whl
- Upload date:
- Size: 14.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: python-requests/2.28.1
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e5fca3abd2a7952f8c1c6c3c6628194c714d12348c75fa91afd2bec24f13d16 |
|
MD5 | 033a3ee48e1c5e87c27c9230c4192ea2 |
|
BLAKE2b-256 | a877c0273bb53c76d42be7f48d4d8e0687431a36e82b0668550441235c44698a |