Skip to main content

Seamless A/B testing with Abby.

Project description

abby

A/B testing for Human

Abby is a A/B testing library package for human. Abby aims to make A/B testing as easy as ABC and accessible to anyone.

PyPI Version Build Status

Installation

$ pip install abby

Quick Start

Please note that your variant name column should be named as variant_name. Otherwise, the method will raise an error and ask you to adjust the column name accordingly.

A/B testing for continuous metric

from abby.datasets import load_dataset
from abby import compare_ttest

data = load_dataset('click_impression')

compare_ttest(data=data, variants=['control', 'experiment'], numerator='click')

A/B testing for ratio metric

from abby.datasets import load_dataset
from abby import compare_delta

data = load_dataset("click_impression")

compare_delta(
    data=data,
    variants=["control", "experiment"],
    numerator="click",
    denominator="impression",
)

A/B testing for ratio metric using bootstrap

from abby.datasets import load_dataset
from abby import compare_bootstrap_delta

data = load_dataset("click_impression")

compare_bootstrap_delta(
    data=data,
    variants=["control", "experiment"],
    numerator="click",
    denominator="impression",
    n_bootstrap=10_000,
)

A/B testing for multiple metrics

from abby.datasets import load_dataset
from abby import compare_multiple, Ratio

data = load_dataset("click_impression")

result = compare_multiple(
    data=data,
    variants=["control", "experiment"],
    metrics=["click", Ratio("click", "impression")],
)

A/B/N testing for multiple metrics

from abby.datasets import load_dataset
from abby import compare_multiple, Ratio

data = load_dataset("click_impression_3_variants")

result = compare_multiple(
    data=data,
    variants=["control", "experiment_A", "experiment_B"],
    metrics=["click", Ratio("click", "impression")],
)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abby-0.1.2.tar.gz (14.5 kB view details)

Uploaded Source

Built Distribution

abby-0.1.2-py3-none-any.whl (14.9 kB view details)

Uploaded Python 3

File details

Details for the file abby-0.1.2.tar.gz.

File metadata

  • Download URL: abby-0.1.2.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.28.1

File hashes

Hashes for abby-0.1.2.tar.gz
Algorithm Hash digest
SHA256 bdb4f7ea30416d6917dffdd4bfa9aedcc5ff565ecbf1c7f8096abed5fd58d706
MD5 2d4a7d25500ac693dbed4941be9de904
BLAKE2b-256 c1b16cf2d47e457df12f13782baf79fb77dcd2fccd82d8336b3fc686572fc712

See more details on using hashes here.

File details

Details for the file abby-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: abby-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 14.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-requests/2.28.1

File hashes

Hashes for abby-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 4e5fca3abd2a7952f8c1c6c3c6628194c714d12348c75fa91afd2bec24f13d16
MD5 033a3ee48e1c5e87c27c9230c4192ea2
BLAKE2b-256 a877c0273bb53c76d42be7f48d4d8e0687431a36e82b0668550441235c44698a

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page