Package for calculating and visualising confidence intervals, e.g. for A/B test analysis.

# Spotify Confidence    Python library for AB test analysis.

## Why use Spotify Confidence?

Spotify Confidence provides convinience wrappers around statsmodel's various functions for computing p-values and confidence intervalls. With Spotify Confidence it's easy to compute several p-values and confidence bounds in one go, e.g. one for each country or for each date. Each function comes in two versions:

• one that return a pandas dataframe,
• one that returns a Chartify chart.

Spotify Confidence has support calculating p-values and confidence intervals using Z-statistics, Student's T-statistics (or more exactly Welch's T-test), as well as Chi-squared statistics.

There is also a Bayesian alternative in the BetaBinomial class.

## Examples

import spotify_confidence as confidence
import pandas as pd

data = pd.DataFrame(
{'variation_name': ['treatment1', 'control', 'treatment2', 'treatment3'],
'success': [50, 40, 10, 20],
'total': [100, 100, 50, 60]
}
)

test = confidence.ZTest(
data,
numerator_column='success',
numerator_sum_squares_column=None,
denominator_column='total',
categorical_group_columns='variation_name',
correction_method='bonferroni')

test.summary()
test.difference(level_1='control', level_2='treatment1')
test.multiple_difference(level='control', level_as_reference=True)

test.summary_plot().show()
test.difference_plot(level_1='control', level_2='treatment1').show()
test.multiple_difference_plot(level='control', level_as_reference=True).show()


See jupyter notebooks in examples folder for more complete examples.

## Installation

Spotify Confidence can be installed via pip:

pip install spotify-confidence

Find the latest release version here

### Code of Conduct

This project adheres to the Open Code of Conduct By participating, you are expected to honor this code.

## Project details

This version 2.7.1 2.7.0 2.6.7 2.6.6 2.6.5 2.6.4 2.6.3 2.6.2 2.6.1 2.6.0 2.5.0 2.4.3 2.4.2 2.4.1 2.4.0 2.3.7 2.3.6 2.3.5 2.3.4 2.3.3 2.3.2 2.3.1 2.3.0 2.2.0 2.1.4 2.1.3 2.1.2 2.1.1 2.1.0 2.0.2 2.0.1

Uploaded source
Uploaded py3