launchdarkly-ai-openai-messages

OpenAI handler for launchdarkly-ai-server using the OpenAI Responses API (openai). Runs a manual function-call loop directly against the Responses API.

provides_for: ['OpenAI', 'messages'] — matches flag variations where provider.name is "OpenAI" and meta.mode is "messages".

Installation

pip install launchdarkly-ai-server launchdarkly-ai-openai-messages

Set OPENAI_API_KEY in your environment (the OpenAI SDK reads it automatically).

Usage

With config()

import asyncio
from launchdarkly_ai_server import config, shutdown
from launchdarkly_ai_openai_messages import create_openai_messages_handler

async def main():
    result = await config(
        key="my-ai-config-flag",
        handler=create_openai_messages_handler(),
        tool_handlers={"search": lambda q: "..."},
    ).invoke("What is feature flagging?", {"kind": "user", "key": "user-123"})

    print(result.response)
    await shutdown()

asyncio.run(main())

Convenience wrapper

import asyncio
from launchdarkly_ai_openai_messages import openai_messages

async def main():
    user_input = "What is feature flagging?"
    result = await openai_messages(
        "my-ai-config-flag",
        user_input,
        {"kind": "user", "key": "user-123"},
    )
    print(result.response)

asyncio.run(main())

How It Works

• Uses the system prompt defined in your LaunchDarkly flag config.
• Template placeholders ({{variable}}) in the prompt are substituted using variables before the call.
• If tools are defined in the flag config, executes them as the model requests and feeds results back until the model produces a final response.
• Emits an OTel span and LaunchDarkly telemetry for every call.

Environment Variables