growthbook 1.1.0

Powerful Feature flagging and A/B testing for Python apps

GrowthBook Python SDK

Powerful Feature flagging and A/B testing for Python apps.

• Lightweight and fast
• Local evaluation, no network requests required
• Python 3.6+
• 100% test coverage
• Flexible targeting
• Use your existing event tracking (GA, Segment, Mixpanel, custom)
• Remote configuration to change feature flags without deploying new code

Installation

pip install growthbook (recommended) or copy growthbook.py into your project

Quick Usage

from growthbook import GrowthBook

# User attributes for targeting and experimentation
attributes = {
  "id": "123",
  "customUserAttribute": "foo"
}

def on_experiment_viewed(experiment, result):
  # Use whatever event tracking system you want
  analytics.track(attributes["id"], "Experiment Viewed", {
    'experimentId': experiment.key,
    'variationId': result.variationId
  })

# Create a GrowthBook instance
gb = GrowthBook(
  attributes = attributes,
  on_experiment_viewed = on_experiment_viewed,
  api_host = "https://cdn.growthbook.io",
  client_key = "sdk-abc123"
)

# Load features from the GrowthBook API with caching
gb.load_features()

# Simple on/off feature gating
if gb.is_on("my-feature"):
  print("My feature is on!")

# Get the value of a feature with a fallback
color = gb.get_feature_value("button-color-feature", "blue")

Web Frameworks (Django, Flask, etc.)

For web frameworks, you should create a new GrowthBook instance for every incoming request and call destroy() at the end of the request to clean up resources.

In Django, for example, this is best done with a simple middleware:

from growthbook import GrowthBook

def growthbook_middleware(get_response):
    def middleware(request):
        request.gb = GrowthBook(
          # ...
        )
        request.gb.load_features()

        response = get_response(request)

        request.gb.destroy() # Cleanup

        return response
    return middleware

Then, you can easily use GrowthBook in any of your views:

def index(request):
    feature_enabled = request.gb.is_on("my-feature")
    # ...

Loading Features

There are two ways to load feature flags into the GrowthBook SDK. You can either use the built-in fetching/caching logic or implement your own custom solution.

Built-in Fetching and Caching

To use the built-in fetching and caching logic, in the GrowthBook constructor, pass in your GrowthBook api_host and client_key. If you have encryption enabled for your GrowthBook endpoint, you also need to pass the decryption_key into the constructor.

Then, call the load_features() method to initiate the HTTP request with a cache layer.

Here's a full example:

gb = GrowthBook(
  api_host = "https://cdn.growthbook.io",
  client_key = "sdk-abc123",
  # How long to cache features in seconds (Optional, default 60s)
  cache_ttl = 60,
)
gb.load_features()

Caching

GrowthBook comes with a custom in-memory cache. If you run Python in a multi-process mode, the different processes cannot share memory, so you likely want to switch to a distributed cache system like Redis instead.

Here is an example of using Redis:

from redis import Redis
import json
from growthbook import GrowthBook, AbstractFeatureCache, feature_repo

class RedisFeatureCache(AbstractFeatureCache):
  def __init__(self):
    self.r = Redis(host='localhost', port=6379)
    self.prefix = "gb:"

  def get(self, key: str):
    data = self.r.get(self.prefix + key)
    # Data stored as a JSON string, parse into dict before returning
    return None if data is None else json.loads(data)

  def set(self, key: str, value: dict, ttl: int) -> None:
    self.r.set(self.prefix + key, json.dumps(value))
    self.r.expire(self.prefix + key, ttl)

# Configure GrowthBook to use your custom cache class
feature_repo.set_cache(RedisFeatureCache())

Custom Implementation

If you prefer to handle the entire fetching/caching logic yourself, you can just pass in a dict of features from the GrowthBook API directly into the constructor:

# From the GrowthBook API
features = {'my-feature':{'defaultValue':False}}

gb = GrowthBook(
  features = features
)

Note: When doing this, you do not need to specify your api_host or client_key and you don't need to call gb.load_features().

GrowthBook class

The GrowthBook constructor has the following parameters:

• enabled (bool) - Flag to globally disable all experiments. Default true.
• attributes (dict) - Dictionary of user attributes that are used for targeting and to assign variations
• url (str) - The URL of the current request (if applicable)
• qa_mode (boolean) - If true, random assignment is disabled and only explicitly forced variations are used.
• on_experiment_viewed (callable) - A function that takes experiment and result as arguments.
• api_host (str) - The GrowthBook API host to fetch feature flags from. Defaults to https://cdn.growthbook.io
• client_key (str) - The client key that will be passed to the API Host to fetch feature flags
• decryption_key (str) - If the GrowthBook API endpoint has encryption enabled, specify the decryption key here
• cache_ttl (int) - How long to cache features in-memory from the GrowthBook API (seconds, default 60)
• features (dict) - Feature definitions from the GrowthBook API (only required if client_key is not specified)
• forced_variations (dict) - Dictionary of forced experiment variations (used for QA)

There are also getter and setter methods for features and attributes if you need to update them later in the request:

gb.set_features(gb.get_features())
gb.set_attributes(gb.get_attributes())

Attributes

You can specify attributes about the current user and request. These are used for two things:

1. Feature targeting (e.g. paid users get one value, free users get another)
2. Assigning persistent variations in A/B tests (e.g. user id "123" always gets variation B)

Attributes can be any JSON data type - boolean, integer, float, string, list, or dict.

attributes = {
  'id': "123",
  'loggedIn': True,
  'age': 21.5,
  'tags': ["tag1", "tag2"],
  'account': {
    'age': 90
  }
}

# Pass into constructor
gb = GrowthBook(attributes = attributes)

# Or set later
gb.set_attributes(attributes)

Tracking Experiments

Any time an experiment is run to determine the value of a feature, you want to track that event in your analytics system.

You can use the on_experiment_viewed option to do this:

from growthbook import GrowthBook, Experiment, Result

def on_experiment_viewed(experiment: Experiment, result: Result):
  # Use whatever event tracking system you want
  analytics.track(attributes["id"], "Experiment Viewed", {
    'experimentId': experiment.key,
    'variationId': result.variationId
  })

# Pass into constructor
gb = GrowthBook(
  on_experiment_viewed = on_experiment_viewed
)

Using Features

There are 3 main methods for interacting with features.

• gb.is_on("feature-key") returns true if the feature is on
• gb.is_off("feature-key") returns false if the feature is on
• gb.get_feature_value("feature-key", "default") returns the value of the feature with a fallback

In addition, you can use gb.evalFeature("feature-key") to get back a FeatureResult object with the following properties:

• value - The JSON-decoded value of the feature (or None if not defined)
• on and off - The JSON-decoded value cast to booleans
• source - Why the value was assigned to the user. One of unknownFeature, defaultValue, force, or experiment
• experiment - Information about the experiment (if any) which was used to assign the value to the user
• experimentResult - The result of the experiment (if any) which was used to assign the value to the user

Sticky Bucketing

By default GrowthBook does not persist assigned experiment variations for a user. We rely on deterministic hashing to ensure that the same user attributes always map to the same experiment variation. However, there are cases where this isn't good enough. For example, if you change targeting conditions in the middle of an experiment, users may stop being shown a variation even if they were previously bucketed into it.

Sticky Bucketing is a solution to these issues. You can provide a Sticky Bucket Service to the GrowthBook instance to persist previously seen variations and ensure that the user experience remains consistent for your users.

A sample InMemoryStickyBucketService implementation is provided for reference, but in production you will definitely want to implement your own version using a database, cookies, or similar for persistence.

Sticky Bucket documents contain three fields

• attributeName - The name of the attribute used to identify the user (e.g. id, cookie_id, etc.)
• attributeValue - The value of the attribute (e.g. 123)
• assignments - A dictionary of persisted experiment assignments. For example: {"exp1__0":"control"}

The attributeName/attributeValue combo is the primary key.

Here's an example implementation using a theoretical db object:

from growthbook import AbstractStickyBucketService, GrowthBook

class MyStickyBucketService(AbstractStickyBucketService):
    # Lookup a sticky bucket document
    def get_assignments(self, attributeName: str, attributeValue: str) -> Optional[Dict]:
        return db.find({
          "attributeName": attributeName,
          "attributeValue": attributeValue
        })

    def save_assignments(self, doc: Dict) -> None:
        # Insert new record if not exists, otherwise update
        db.upsert({
            "attributeName": doc["attributeName"],
            "attributeValue": doc["attributeValue"]
        }, {
          "$set": {
            "assignments": doc["assignments"]
          }
        })

# Pass in an instance of this service to your GrowthBook constructor

gb = GrowthBook(
  sticky_bucket_service = MyStickyBucketService()
)

Inline Experiments

Instead of declaring all features up-front and referencing them by ids in your code, you can also just run an experiment directly. This is done with the run method:

from growthbook import Experiment

exp = Experiment(
  key = "my-experiment",
  variations = ["red", "blue", "green"]
)

# Either "red", "blue", or "green"
print(gb.run(exp).value)

As you can see, there are 2 required parameters for experiments, a string key, and an array of variations. Variations can be any data type, not just strings.

There are a number of additional settings to control the experiment behavior:

• key (str) - The globally unique tracking key for the experiment
• variations (any[]) - The different variations to choose between
• seed (str) - Added to the user id when hashing to determine a variation. Defaults to the experiment key
• weights (float[]) - How to weight traffic between variations. Must add to 1.
• coverage (float) - What percent of users should be included in the experiment (between 0 and 1, inclusive)
• condition (dict) - Targeting conditions
• force (int) - All users included in the experiment will be forced into the specified variation index
• hashAttribute (string) - What user attribute should be used to assign variations (defaults to "id")
• hashVersion (int) - What version of our hashing algorithm to use. We recommend using the latest version 2.
• namespace (tuple[str,float,float]) - Used to run mutually exclusive experiments.

Here's an example that uses all of them:

exp = Experiment(
  key="my-test",
  # Variations can be a list of any data type
  variations=[0, 1],
  # If this changes, it will re-randomize all users in the experiment
  seed="abcdef123456",
  # Run a 40/60 experiment instead of the default even split (50/50)
  weights=[0.4, 0.6],
  # Only include 20% of users in the experiment
  coverage=0.2,
  # Targeting condition using a MongoDB-like syntax
  condition={
    'country': 'US',
    'browser': {
      '$in': ['chrome', 'firefox']
    }
  },
  # Use an alternate attribute for assigning variations (default is 'id')
  hashAttribute="sessionId",
  # Use the latest hashing algorithm
  hashVersion=2,
  # Includes the first 50% of users in the "pricing" namespace
  # Another experiment with a non-overlapping range will be mutually exclusive (e.g. [0.5, 1])
  namespace=("pricing", 0, 0.5),
)

Inline Experiment Return Value

A call to run returns a Result object with a few useful properties:

result = gb.run(exp)

# If user is part of the experiment
print(result.inExperiment) # True or False

# The index of the assigned variation
print(result.variationId) # e.g. 0 or 1

# The value of the assigned variation
print(result.value) # e.g. "A" or "B"

# If the variation was randomly assigned by hashing user attributes
print(result.hashUsed) # True or False

# The user attribute used to assign a variation
print(result.hashAttribute) # "id"

# The value of that attribute
print(result.hashValue) # e.g. "123"

The inExperiment flag will be false if the user was excluded from being part of the experiment for any reason (e.g. failed targeting conditions).

The hashUsed flag will only be true if the user was randomly assigned a variation. If the user was forced into a specific variation instead, this flag will be false.

Example Experiments

3-way experiment with uneven variation weights:

gb.run(Experiment(
  key = "3-way-uneven",
  variations = ["A","B","C"],
  weights = [0.5, 0.25, 0.25]
))

Slow rollout (10% of users who match the targeting condition):

# User is marked as being in "qa" and "beta"
gb = GrowthBook(
  attributes = {
    "id": "123",
    "beta": True,
    "qa": True,
  },
)

gb.run(Experiment(
  key = "slow-rollout",
  variations = ["A", "B"],
  coverage = 0.1,
  condition = {
    'beta': True
  }
))

Complex variations

result = gb.run(Experiment(
  key = "complex-variations",
  variations = [
    ("blue", "large"),
    ("green", "small")
  ],
))

# Either "blue,large" OR "green,small"
print(result.value[0] + "," + result.value[1])

Assign variations based on something other than user id

gb = GrowthBook(
  attributes = {
    "id": "123",
    "company": "growthbook"
  }
)

# Users in the same company will always get the same variation
gb.run(Experiment(
  key = "by-company-id",
  variations = ["A", "B"],
  hashAttribute = "company"
))

Logging

The GrowthBook SDK uses a Python logger with the name growthbook and includes helpful info for debugging as well as warnings/errors if something is misconfigured.

Here's an example of logging to the console

import logging

logger = logging.getLogger('growthbook')
logger.setLevel(logging.DEBUG)

handler = logging.StreamHandler()
formatter = logging.Formatter('%(asctime)s %(name)s %(levelname)s %(message)s')
handler.setFormatter(formatter)
logger.addHandler(handler)