noveum-trace 1.5.13

Cloud-first tracing SDK for LLM applications and multi-agent systems

Noveum Trace SDK

Simple, intuitive tracing SDK for LLM applications and multi-agent systems.

Noveum Trace provides an easy way to add observability to your LLM applications. With intuitive context managers, you can trace function calls, LLM interactions, agent workflows, and multi-agent coordination patterns.

✨ Key Features

• 🎯 Simple Context Manager API - Add tracing with intuitive with statements
• 🤖 Multi-Agent Support - Built for multi-agent systems and workflows
• ☁️ Cloud Integration - Send traces to Noveum platform or custom endpoints
• 🔌 Framework Agnostic - Works with any Python LLM framework
• 🚀 Minimal Setup - Get started in minutes with sensible defaults
• 📊 Comprehensive Tracing - Capture function calls, LLM interactions, and agent workflows
• 🔄 Flexible Integration - Context managers for granular control

🚀 Quick Start

Installation

pip install noveum-trace

Basic Usage

import noveum_trace

# Initialize the SDK
noveum_trace.init(
    api_key="your-api-key",
    project="my-llm-app"
)

# Trace any operation using context managers
def process_document(document_id: str) -> dict:
    with noveum_trace.trace_operation("process_document") as span:
        # Your function logic here
        span.set_attribute("document_id", document_id)
        return {"status": "processed", "id": document_id}

# Trace LLM calls with automatic metadata capture
def call_openai(prompt: str) -> str:
    import openai
    client = openai.OpenAI()

    with noveum_trace.trace_llm_call(model="gpt-4", provider="openai") as span:
        response = client.chat.completions.create(
            model="gpt-4",
            messages=[{"role": "user", "content": prompt}]
        )
        span.set_attributes({
            "llm.input_tokens": response.usage.prompt_tokens,
            "llm.output_tokens": response.usage.completion_tokens
        })
        return response.choices[0].message.content

📦 Import Patterns

Noveum Trace supports multiple import patterns. Choose the one that best fits your coding style:

Recommended: Direct Imports from Package Root

This is the recommended approach for most use cases:

from noveum_trace import init, trace_context, NoveumClient
from noveum_trace import trace_llm_call, trace_operation, trace_agent_operation

Available imports from root:

• Core functions: init, shutdown, flush, configure, get_config, get_client
• Context managers: trace_context, trace_llm_call, trace_operation, trace_agent_operation, trace_batch_operation, trace_pipeline_stage, create_child_span
• Core classes: NoveumClient, Trace, Span, ContextualTrace
• Integrations: NoveumTraceCallbackHandler (LangChain integration)

Alternative: Module-Level Imports

For simple scripts or when you prefer namespace qualification:

import noveum_trace

# Initialize
noveum_trace.init(project="my-app", api_key="your-api-key")

# Use context managers
with noveum_trace.trace_llm_call(model="gpt-4") as span:
    # Your code here
    pass

# Flush traces
noveum_trace.flush()

Submodule Imports (When Needed)

For advanced use cases or when importing items not in the root __all__:

# Integrations (conditional - requires langchain/livekit)
from noveum_trace.integrations.langchain import NoveumTraceCallbackHandler
from noveum_trace.integrations.livekit import (
    LiveKitSTTWrapper,
    LiveKitTTSWrapper,
    setup_livekit_tracing,
)

# Core submodules (also valid, but root imports preferred)
from noveum_trace.core.client import NoveumClient
from noveum_trace.core.span import Span, SpanStatus
from noveum_trace.core.trace import Trace

What Doesn't Work

These import patterns will fail:

# ❌ NoveumTrace class doesn't exist
from noveum_trace import NoveumTrace  # ModuleNotFoundError

# ❌ Wrong path - should be core.client or root import
from noveum_trace.client import NoveumClient  # ModuleNotFoundError
# ✅ Correct:
from noveum_trace import NoveumClient
# or
from noveum_trace.core.client import NoveumClient

Quick Reference Table

What to Import	Recommended Import	Alternative
Initialize SDK	from noveum_trace import init	import noveum_trace then noveum_trace.init()
LLM tracing	from noveum_trace import trace_llm_call	import noveum_trace then noveum_trace.trace_llm_call()
Context manager	from noveum_trace import trace_context	import noveum_trace then noveum_trace.trace_context()
Client class	from noveum_trace import NoveumClient	from noveum_trace.core.client import NoveumClient
LangChain integration	from noveum_trace.integrations.langchain import NoveumTraceCallbackHandler	from noveum_trace.integrations import NoveumTraceCallbackHandler (also works)
LiveKit integration	from noveum_trace.integrations.livekit import setup_livekit_tracing	from noveum_trace.integrations.livekit import LiveKitSTTWrapper, LiveKitTTSWrapper
Pipecat integration	from noveum_trace.integrations.pipecat import NoveumTraceObserver, setup_pipecat_tracing	requires pip install "noveum-trace[pipecat]"
CrewAI integration	from noveum_trace.integrations.crewai import NoveumCrewAIListener, setup_crewai_tracing	requires Python 3.10+, pip install "noveum-trace[crewai]"

⚙️ Setup

Core Configuration

The SDK requires a few core environment variables to function:

# Required: Your Noveum API key
export NOVEUM_API_KEY="your-api-key"

# Required: Project name for organizing traces
export NOVEUM_PROJECT="your-project-name"

# Optional: Environment name (defaults to "development")
export NOVEUM_ENVIRONMENT="production"

# Optional: Custom API endpoint (defaults to https://api.noveum.ai/api)
export NOVEUM_ENDPOINT="https://api.noveum.ai/api"

Additional Environment Variables

For a complete list of all available environment variables including debug settings, logging configuration, and agent registry limits, see .env.example in the repository root.

🏗️ Architecture

noveum_trace/
├── core/              # Core tracing primitives (Trace, Span, Context)
├── context_managers.py # Context managers for inline tracing
├── agents/            # Agent registry and workflow management
├── streaming/         # Streaming LLM response support
├── threads/           # Conversation thread management
├── transport/         # HTTP transport and batch processing
├── integrations/      # Framework integrations (LangChain, LiveKit, Pipecat, CrewAI)
└── utils/             # Utilities (exceptions, serialization, etc.)

🔧 Configuration

Environment Variables

The SDK can be configured via environment variables. The core configuration variables are:

export NOVEUM_API_KEY="your-api-key"
export NOVEUM_PROJECT="your-project-name"
export NOVEUM_ENVIRONMENT="production"

Programmatic Configuration

import noveum_trace

# Basic configuration
noveum_trace.init(
    api_key="your-api-key",
    project="my-project",
    environment="production"
)

# Advanced configuration with transport settings
noveum_trace.init(
    api_key="your-api-key",
    project="my-project",
    environment="production",
    transport_config={
        "batch_size": 50,
        "batch_timeout": 2.0,
        "retry_attempts": 3,
        "timeout": 30
    },
    tracing_config={
        "sample_rate": 1.0,
        "capture_errors": True,
        "capture_stack_traces": False
    }
)

🔄 Context Manager Usage

For scenarios with granular control:

import noveum_trace

def process_user_query(user_input: str) -> str:
    # Pre-processing (not traced)
    cleaned_input = user_input.strip().lower()

    # Trace just the LLM call
    with noveum_trace.trace_llm_call(model="gpt-4", provider="openai") as span:
        response = openai_client.chat.completions.create(
            model="gpt-4",
            messages=[{"role": "user", "content": cleaned_input}]
        )

        # Add custom attributes
        span.set_attributes({
            "llm.input_tokens": response.usage.prompt_tokens,
            "llm.output_tokens": response.usage.completion_tokens
        })

    # Post-processing (not traced)
    return format_response(response.choices[0].message.content)

def multi_step_workflow(task: str) -> dict:
    results = {}

    # Trace agent operation
    with noveum_trace.trace_agent_operation(
        agent_type="planner",
        operation="task_planning"
    ) as span:
        plan = create_task_plan(task)
        span.set_attribute("plan.steps", len(plan.steps))
        results["plan"] = plan

    # Trace tool usage
    with noveum_trace.trace_operation("database_query") as span:
        data = query_database(plan.query)
        span.set_attributes({
            "query.results_count": len(data),
            "query.table": "tasks"
        })
        results["data"] = data

    return results

🔗 LangChain Integration

Noveum Trace provides seamless integration with LangChain and LangGraph applications through a simple callback handler.

from noveum_trace.integrations.langchain import NoveumTraceCallbackHandler
from langchain_openai import ChatOpenAI

# Initialize Noveum Trace
import noveum_trace
noveum_trace.init(project="my-langchain-app", api_key="your-api-key")

# Create callback handler
handler = NoveumTraceCallbackHandler()

# Add to your LangChain components
llm = ChatOpenAI(callbacks=[handler])
response = llm.invoke("What is the capital of France?")

What Gets Traced

• LLM Calls: Model, prompts, responses, token usage
• Chains: Input/output flow, execution steps
• Agents: Decision-making, tool usage, reasoning
• Tools: Function calls, inputs, outputs
• LangGraph Nodes: Graph execution, node transitions
• Routing Decisions: Conditional routing logic and decisions

Advanced Features

The integration also supports:

• Manual Trace Control for complex workflows
• Custom Parent Relationships for explicit span hierarchies
• LangGraph Routing Tracking for routing decisions

For complete details and examples, see the LangChain Integration Guide.

🎤 LiveKit Integration

Automatically trace LiveKit agent sessions with complete observability:

import noveum_trace
from livekit.agents import Agent, AgentSession, JobContext
from livekit.plugins import deepgram, cartesia
from noveum_trace.integrations.livekit import (
    LiveKitSTTWrapper,
    LiveKitTTSWrapper,
    setup_livekit_tracing,
)

# Initialize noveum-trace
noveum_trace.init(project="livekit-agent")

async def agent_entrypoint(ctx: JobContext):
    # Wrap STT/TTS providers for detailed audio tracking
    traced_stt = LiveKitSTTWrapper(
        stt=deepgram.STT(model="nova-2"),
        session_id=ctx.job.id,
        job_context={"job_id": ctx.job.id, "room": ctx.room.name}
    )

    traced_tts = LiveKitTTSWrapper(
        tts=cartesia.TTS(model="sonic-english"),
        session_id=ctx.job.id,
        job_context={"job_id": ctx.job.id}
    )

    # Create session with traced providers
    session = AgentSession(stt=traced_stt, tts=traced_tts)

    # Enable session tracing for automatic event tracking
    # This creates the trace automatically - no need for start_trace()
    setup_livekit_tracing(session)

    agent = Agent(instructions="You are a helpful assistant.")
    await ctx.connect()
    await session.start(agent)  # Complete tracing active!

What Gets Traced

Session Events (automatic):

• AgentSession Events: State changes, transcriptions, function calls, errors, metrics
• RealtimeSession Events: Speech detection, transcriptions, generations (when using RealtimeModel)
• Automatic Trace Creation: Trace is created when session.start() is called

STT/TTS Operations (via wrappers):

• STT Operations: Transcripts, confidence scores, audio files, durations
• TTS Operations: Synthesized text, audio files, durations
• Job Context: Room info, participant details, agent metadata
• Audio Capture: Automatic saving of audio files for debugging

Key Features

• ✅ Complete Observability: Session events + detailed STT/TTS tracking
• ✅ Zero Configuration: Session tracing creates trace automatically
• ✅ Works with any LiveKit STT/TTS provider
• ✅ Automatic audio file capture and storage
• ✅ Rich metadata in span attributes
• ✅ Graceful degradation (no disruption if tracing fails)

For step-by-step setup instructions, see the LiveKit Integration Guide.

For detailed API documentation, see the LiveKit Integration Docs.

🤖 Pipecat Integration

Automatically trace Pipecat voice agent pipelines:

import noveum_trace
from noveum_trace.integrations.pipecat import NoveumTraceObserver, setup_pipecat_tracing
from pipecat.pipeline.pipeline import Pipeline
from pipecat.pipeline.runner import PipelineRunner
from pipecat.pipeline.task import PipelineTask

# Initialize Noveum Trace
noveum_trace.init(project="pipecat-agent", api_key="your-api-key")

async def run_agent():
    pipeline = Pipeline([...])  # Your Pipecat pipeline

    # Create observer using factory
    observer = setup_pipecat_tracing(trace_name_prefix="my-bot")

    task = PipelineTask(pipeline, observers=[observer])
    await observer.attach_to_task(task)  # Wires turn tracking

    runner = PipelineRunner()
    await runner.run(task)

Installation

pip install "noveum-trace[pipecat]"

For full documentation, see the Pipecat Integration Guide.

🤝 CrewAI Integration

Trace CrewAI crews, agents, tasks, and tools automatically:

import noveum_trace
from noveum_trace.integrations.crewai import NoveumCrewAIListener, setup_crewai_tracing
from crewai import Crew, Agent, Task

# Initialize Noveum Trace (Python 3.10+ required for CrewAI)
noveum_trace.init(project="crewai-app", api_key="your-api-key")

# Create your crew
crew = Crew(agents=[...], tasks=[...])

# Option 1: Using the setup factory (recommended)
listener = setup_crewai_tracing()
crew.callback_function = listener
result = crew.kickoff()

# Option 2: Manual instantiation with full control
from noveum_trace import get_client
client = get_client()
listener = NoveumCrewAIListener(client)
crew.callback_function = listener
result = crew.kickoff()

Installation

# Requires Python 3.10+
pip install "noveum-trace[crewai]"

For a complete working example, see docs/examples/crewai_e2e_test.py.

🧪 Testing

Run the test suite:

# Install development dependencies
pip install -e ".[dev]"

# Run all tests
pytest

# Run with coverage
pytest --cov=noveum_trace --cov-report=html

# Run specific test categories
pytest -m llm
pytest -m agent

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

Development Setup

# Clone the repository
git clone https://github.com/Noveum/noveum-trace.git
cd noveum-trace

# Install in development mode
pip install -e ".[dev]"

# Run tests
pytest

# Run examples
python docs/examples/basic_usage.py

📖 Examples

Check out the examples directory for complete working examples:

• Basic Usage - Simple function tracing
• Flexible Tracing - Context managers and inline tracing
• LangChain Integration - LangChain and LangGraph integration
• LangGraph Routing - LangGraph routing decision tracking

🚀 Advanced Usage

Manual Trace Creation

# Create traces manually for full control
client = noveum_trace.get_client()

with client.create_contextual_trace("custom_workflow") as trace:
    with client.create_contextual_span("step_1") as span1:
        # Step 1 implementation
        span1.set_attributes({"step": 1, "status": "completed"})

    with client.create_contextual_span("step_2") as span2:
        # Step 2 implementation
        span2.set_attributes({"step": 2, "status": "completed"})

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

🙋‍♀️ Support

• GitHub Issues
• Documentation
• Examples

---

Built by the Noveum Team