Skip to main content

le_AB_logo

le AB is a Python library for AB testing analysis.

⚡️ Quick start

Open In Colab

Before launching your AB test, you can compute the needed sample size per variation :

>>> from leab import before

>>> ab_test = before.leSample(conversion_rate=20,
...                           min_detectable_effect=2)
>>> ab_test.get_size_per_variation()

6347

After reaching the needed sample size, you can compare means obtained from A VS B :

>>> from leab import after
>>> from leab import leDataset

>>> data = leDataset.SampleLeAverage()

>>> ab_test = after.leAverage(data.A, data.B)
>>> teab_testst.get_verdict()

'Sample A mean is greater'

🛠 Installation

🐍 You need to install Python 3.12 or above.

Installation can be done by using pip.
There are wheels available for Linux, MacOS, and Windows.

pip install leab

You can also install the latest development version as so:

pip install git+https://github.com/tlentali/leab

# Or, through SSH:
pip install git+ssh://git@github.com/tlentali/leab.git

🥄 Philosophy

"Life is a sum of all our choices."
Albert Camus

Get ready to take a decision !

AB testing has never been more popular, especially on Internet based companies.
Even if each test is unique, some questions seem to be asked again and again :

  • when is my test going to be statistically significant ?
  • is A more successful than B ?
  • does A generate more than B ?

Strong statistical knowledge are required to handle it from start to end correctly.
To answer those questions in a simple and robust way, we built le AB.
Lets Python do AB testing analysis !

🔥 Features

Here are some benefits of using Le AB :

  • Sample size : How many subjects are needed for my AB test ?
  • Test duration : How many days are needed for my AB test ?
  • Rate of success : Does the rate of success differ across two groups ?
  • Average value : Does the average value differ across two groups ?

🙏 Thanks

This project takes its inspiration from Evan Miller great work, especially the following :

Thank you so much Evan M. for your work, it saved our lives so many times !

A big thanks to Max Halford too, who inspired us in the structure of this project, particularly for docs and tests.
Have a look at Creme-ml, it's just amazingly done !

To finish, thanks to all of you who use or are going to use this lib, hope it helps !

🖖 Contributing

Feel free to contribute in any way you like, we're always open to new ideas and approaches. If you want to contribute to the code base please check out the CONTRIBUTING.md file. Also take a look at the issue tracker and see if anything takes your fancy.

This project follows the all-contributors specification. Again, contributions of any kind are welcome!

tlentali
tlentali

📆 💻
JLouedec
JLouedec

📝
RomainSa
RomainSa

📝

📜 License

le AB is free and open-source software licensed under the 3-clause BSD license.

Metadata

Release files for leab 0.1.11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for leab 0.1.11
File Size Uploaded Provenance Actions
leab-0.1.11.tar.gz 5.4 kB Without provenance Details for leab-0.1.11.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for leab 0.1.11
File Interpreter ABI Platform Actions
leab-0.1.11-py3-none-any.whl Python 3 none any Details for leab-0.1.11-py3-none-any.whl

Total release size: 10.1 kB

Release files / leab-0.1.11.tar.gz

Download URL leab-0.1.11.tar.gz
Size 5.4 kB
Tags Source
SHA-256 checksum
How to use checksums
88e04bb6edb15765c78139d1c0644df32162ba5a9a766e54e1d247a9ddbdc69d
BLAKE2b-256 checksum
How to use checksums
72e81cb8a18eab7fc299298522cde7582ba64df68384032f9c58a246ca7962f3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release files / leab-0.1.11-py3-none-any.whl

Download URL leab-0.1.11-py3-none-any.whl
Size 4.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a7def6c75193f1eb5abe51fa0ad49fe7653bd4820107d04255fcb0b098b6bf7a
BLAKE2b-256 checksum
How to use checksums
f198f278239e38df2c401dbb223d9c1e1d35c255db83852b33dca79c9c7f2461
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Security for leab 0.1.11

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page