Janus, an A/B Test Framework.
Project description
Janus
Janus is an A/B Test Engine to be used in a variety use cases, especially to measure conversion, ticket and ARPU difference between variants, i.e, typical metrics for tests in marketplaces. The engine name is an analogy to Janus, the god of changes and transitions.
This library came as an ideia of separate the statistical calculations in A/B Tests from other code that is typically used to manage tests and execute queries over the company's database, and hence usually carry proprietary code and even business logic, which should not be open sourced. There was the bud to build this library and get it open sourced.
Checkout the streamlit app from this repo.
Installation
Open a terminal, clone this repository into your machine and stay into the project directory.
Using a virtual environment is a good practice, but it is optional. If you enjoy it, go ahead and create a virtual environment by typing:
python3 -m venv venv -r requirements.txt
Once it is created, you must now activate the environment by using:
source venv/bin/activate
Now, you can install our lib (if you are not using virtual env, go straight to this command):
make install
And that's it! Now, inside our environment, we can import the janus
lib inside our scripts with plain import janus
etc. Try to test using the same code on experiment_example.ipynb
notebook here or in a plain terminal.
Using as an Application
You can use janus as a streamlit product. Just run make run
and an streamlit app will launch.
References
- What is A/B Testing
- VWO paper about bayesian A/B testing
- Agile A/B testing with Bayesian Statistics and Python
- Understanding Bayesian A/B testing (using baseball statistics)
- It’s time to re-think A/B testing
- Conjugate Priors
- Curso de Teste A/B Bayesiano do Lazy Programmer
- Binomial Distributions
- Bayes theorem
- The quick proof of Bayes Theorem
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for janus_web_ab_testing-0.1.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | abe2fc22380f970ae22ee1319cb4d5cb34cff8f7491ce5903fe98eb045ab3e12 |
|
MD5 | 185a3534d2c6fdbd5cffec262279c05e |
|
BLAKE2b-256 | 26040280defc6414d482a7ca068f54b543f597d5593ce946ad065eb49955b62b |
Hashes for janus_web_ab_testing-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b1af2a7139497324d1614a9c0b66a9073850fac2f660df45d0fb3517e8624d1 |
|
MD5 | c60e5078edb82ae71c974928bf0b899f |
|
BLAKE2b-256 | c1ac8a8f54ab0a9a7fa327cd517c201f2c1bc180b769ed41da9074df8fc5e447 |