Skip to main content

Utilities for randomizing A/B tests

Project description

GetCohorts

CI Actions Status PyPI version codecov

GetCohorts provides an endpoint that will randomly determine a cohort for user in an A/B test, and is gauranteed to always assign the same user to the same cohort for the same experiment.

>>> import requests
>>> resp = requests.get('http://api.getcohorts.com/v1/cohorts', json={
...    'identifier': 'user1',
...    'experiment': 'homepage-test'
... })
>>> print(resp.json()['cohort'])
experimental

Quickstart

GetCohorts provides a web service at http://api.getcohorts.com that you can use for testing. But that service runs on Heroku's free tier, and can occasionally have slow response times. We recommend that you deploy GetCohorts yourself.

The easiest way to deploy GetCohorts is with docker.

docker run --publish 8000:8000 tjwaterman99/getcohorts

For more details on using the service, you can read the documentation and API reference.

Development

Clone this repo.

git clone https://github.com/tjwaterman99/getcohorts.git

Install the package's dependencies, and install getcohorts in editable mode.

pip install -r requirements.txt
pip install --editable .

To run the webserver, install the Heroku cli.

sudo snap install --clasic heroku
heroku local

The webserver will run on port 8000.

Testing

Run the tests with pytest

pytest

You can run the github CI workflows locally if you have act installed. You'll also need to create a file .secrets that contains deployment secrets for the staging environments.

# .secrets
AWS_ACCESS_KEY_ID=...
AWS_SECRET_ACCESS_KEY=...
DOCS_S3_BUCKET=...

PYPI_USERNAME=...
PYPI_REPOSITORY_URL=...
PYPI_ACCESS_TOKEN=...

Then run the Github workflows.

sudo act --secret-file .secrets

Documentation

Build the docs with sphinx-autobuild. The site is available at 0.0.0.0:8000.

sphinx-autobuild docs docs/_build

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

getcohorts-0.1.7.tar.gz (3.5 kB view hashes)

Uploaded Source

Built Distribution

getcohorts-0.1.7-py3-none-any.whl (4.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page