Skip to main content

SQL translator for Flagsmith segment predicates.

Project description

flagsmith-sql-flag-engine

SQL translator for Flagsmith segment predicates.

Where the Python and Rust flag_engine implementations evaluate is_context_in_segment against an in-memory EvaluationContext, this package takes a SegmentContext and emits a SQL WHERE expression that evaluates the segment against an entire IDENTITIES table — one row per identity, with the identity's full trait map held in a single column the translator path-extracts at query time. PERCENTAGE_SPLIT and :semver-marked comparators compile to inline pure-SQL.

Quickstart

from flag_engine.context.types import EvaluationContext, SegmentContext

from flagsmith_sql_flag_engine import TranslateContext, translate_segment
from flagsmith_sql_flag_engine.dialects import ClickHouseDialect

eval_context: EvaluationContext = {
    "environment": {"key": "n9fbf9...3ngWhb", "name": "Production"},
}
ctx = TranslateContext(evaluation_context=eval_context, dialect=ClickHouseDialect())

segment: SegmentContext = {
    "key": "growth-cohort",
    "name": "Growth cohort",
    "rules": [
        {
            "type": "ALL",
            "conditions": [
                {"operator": "EQUAL", "property": "plan", "value": "growth"},
            ],
        },
    ],
}
where_expr = translate_segment(segment, ctx)
# where_expr is a SQL string. Drop into:
#   SELECT COUNT(*) FROM IDENTITIES i
#   WHERE i.environment_id = 'n9fbf9...3ngWhb' AND ({where_expr})

environment_id in the IDENTITIES table is a string column holding EnvironmentContext.key directly — the same identifier the engine uses, no separate integer PK.

translate_segment returns None if the segment uses an operator the translator can't handle — typically a REGEX pattern the active dialect's regex flavour can't compile. Callers should fall back to flag_engine.is_context_in_segment for those segments.

Bound parameters

By default the translator inlines each segment value as an escaped SQL string literal. Pass a Binder on the TranslateContext to bind value-bearing literals as query parameters instead.

from flagsmith_sql_flag_engine import (
    Binder,
    PyformatParamStyle,
    TranslateContext,
    translate_segment,
)
from flagsmith_sql_flag_engine.dialects import ClickHouseDialect

binder = Binder(PyformatParamStyle())
ctx = TranslateContext(
    evaluation_context=eval_context,
    dialect=ClickHouseDialect(),
    binder=binder,
)
where_expr = translate_segment(segment, ctx)

Hand both to the driver:

   cursor.execute(f"... WHERE ({where_expr})", binder.params)

Currently, %-prefixed style PyformatParamStyle and ClickHouse-specific ClickHouseServerParamStyle are supported.

Schema

Each dialect publishes the table layout it expects via a schema_ddl constant. For ClickHouse:

CREATE TABLE IF NOT EXISTS IDENTITIES (
    environment_id String,
    id UInt64,
    identifier String,
    identity_key String,
    traits JSON
)
ENGINE = MergeTree()
ORDER BY (environment_id, id);

Traits live in a single JSON column (CH 24+, GA in 25.x). Each key is stored as a typed subcolumn, so trait reads are direct columnar scans rather than per-row JSON parses. Trait keys are data — new keys appear without schema changes — and the translator only sees the abstract path extraction.

ClickHouse Cloud requires SET allow_experimental_json_type = 1 when creating a JSON-column table (the type is GA on OSS 25.x); the test harness applies this setting automatically.

Programmatic access:

from flagsmith_sql_flag_engine.dialects.clickhouse import SCHEMA_DDL

Engine parity

Validated against Flagsmith/engine-test-data, the test suite every engine implementation is checked against. The engine-parity suite loads each test case's identity into a per-dialect scratch table, translates the case's segments, runs the generated SQL, and compares to flag_engine.is_context_in_segment.

To run the engine-parity suite locally:

git submodule update --init                 # pull engine-test-data
docker compose up --detach --wait clickhouse
uv run pytest tests/test_engine.py

Adding a new dialect's parity coverage is one harness module — see tests/harnesses/ for the shape.

Dialects

The translator is dialect-aware: a Dialect protocol abstracts the SQL fragments that differ across SQL engines — MD5 hex, hex-to-int parsing, prefix-anchored regex, padded-version comparison, type-aware trait predicates, regex flavour. Today ClickHouseDialect is the only implementation; adding another engine such as Snowflake, DuckDB or Postgres means writing one class.

Operator coverage

Operator Translatable Notes
EQUAL, NOT_EQUAL, IN yes
IS_SET, IS_NOT_SET yes trait subcolumn IS NOT NULL / IS NULL
CONTAINS, NOT_CONTAINS yes
GREATER_THAN, LESS_THAN plus _INCLUSIVE yes
MODULO yes
PERCENTAGE_SPLIT yes inlined MD5-mod-9999; ~0.005% diverge on hash==9998
REGEX partial dialect-flavour gated; unsupported patterns → caller fallback
:semver-marked comparators yes major.minor.patch only; ignores prerelease

Development

make install                  # uv sync + pre-commit install
make lint                     # run pre-commit hooks across the tree
make typecheck                # mypy
make test                     # unit tests

Ruff (lint + format) runs as a pre-commit hook on every commit. Mypy runs as a make typecheck hook on staged Python files.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

flagsmith_sql_flag_engine-0.2.0.tar.gz (19.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

flagsmith_sql_flag_engine-0.2.0-py3-none-any.whl (23.7 kB view details)

Uploaded Python 3

File details

Details for the file flagsmith_sql_flag_engine-0.2.0.tar.gz.

File metadata

File hashes

Hashes for flagsmith_sql_flag_engine-0.2.0.tar.gz
Algorithm Hash digest
SHA256 38af827ba846795b04d7504e47498875bbfb6951c26177427b0e6378eaebed52
MD5 c57840e3c55dfe03a70c8aeddca48f84
BLAKE2b-256 7234961758e0946ffd430cf90480dce67fd7b548269749b174961d6380f2fb57

See more details on using hashes here.

Provenance

The following attestation bundles were made for flagsmith_sql_flag_engine-0.2.0.tar.gz:

Publisher: publish.yml on Flagsmith/flagsmith-sql-flag-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file flagsmith_sql_flag_engine-0.2.0-py3-none-any.whl.

File metadata

File hashes

Hashes for flagsmith_sql_flag_engine-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a30658d740a3c7f8111c3475005f8ec75a9f9ad7ce4ab58e4fd300364dca139c
MD5 1f36d8748f83d1473472177a48396e07
BLAKE2b-256 22596ea43aba79109cbd4feaad3623a7554d4364c1b825d1989ba6410764aa0f

See more details on using hashes here.

Provenance

The following attestation bundles were made for flagsmith_sql_flag_engine-0.2.0-py3-none-any.whl:

Publisher: publish.yml on Flagsmith/flagsmith-sql-flag-engine

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page