coalex

Python SDK for Coalex — AI governance observability for enterprises in regulated markets.

Built on OpenTelemetry.

Install

pip install coalex
# or
uv add coalex

Quick start

import coalex

coalex.register(api_key=os.environ["COALEX_API_KEY"], service_name="my-agent")
coalex.auto_instrument()

with coalex.coalex_context(agent_id="support-agent"):
    answer = my_agent.run(question)

decision = coalex.evaluate(
    request_id=request_id,
    input={"question": question},
    output={"answer": answer},
    # The metric catalogue is validated before the call: f1, word_overlap, bleu, rouge_l,
    # exact_match, levenshtein, contains. This line used to read ["faithfulness"], which is not
    # one of them — so the first example a customer copied raised ValueError (COA-2377).
    metrics={"answer": ["f1", "word_overlap"]},
)

Diagnostics

The SDK logs under the coalex logger and never configures logging for you — a library that calls basicConfig takes over your application's log configuration, which is not its to take. It attaches a NullHandler and leaves the rest to you.

To see what it is doing:

import logging

logging.basicConfig(level=logging.INFO)          # your application's own setup
logging.getLogger("coalex").setLevel(logging.DEBUG)

Without raising the level you still get warnings and errors — but only through Python's lastResort handler if your application configures none of its own, which prints with no timestamp, level or logger name and cannot be filtered.

No API key, proxy token or upstream credential reaches a log line or an exception message. Raising the level does not change that: it is a property of what is written, not of what is filtered.

Telemetry never breaks your agent

A failing Coalex endpoint drops spans; it does not raise into your code. evaluate() and resolve() do raise, because a governance decision you asked for and did not get is not something to swallow.

TypeScript

There is a TypeScript SDK, and it is smaller. See Python vs TypeScript before choosing.

Documentation

https://docs.coalex.ai