Skip to main content

Voice Analytics SDK for AI Agents

Project description

Obsera SDK

Professional Voice Analytics for AI Agents

Monitor, analyze, and gain insights from your AI voice agent conversations with Obsera's advanced voice analytics platform.

🚀 Quick Start

Installation

pip install obsera

Get Your Credentials

  1. Sign up at Obsera Voice Analytics Dashboard
  2. Get your Agent ID from the dashboard
  3. Generate your API Key from your account

Environment Setup

Create a .env file in your project root:

# Obsera Voice Analytics
PYPE_API_KEY=your_pype_api_key_here

📖 Complete Implementation

Here's a complete example of how to integrate Pype Observe into your LiveKit voice agent:

from dotenv import load_dotenv
from livekit import agents
from livekit.agents import AgentSession, Agent, RoomInputOptions
from livekit.plugins import (
    openai,
    deepgram,
    noise_cancellation,
    silero,
    elevenlabs,
)
from livekit.plugins.turn_detector.multilingual import MultilingualModel
from horus import LivekitObserve

import base64
import os

# Load environment variables
load_dotenv()

# 🎙️ Initialize Obsera with your Agent ID from the dashboard
pype = LivekitObserve(
    agent_id="your-agent-id-from-dashboard"  # Get this from https://pype-voice-analytics-dashboard.vercel.app/
)

class Assistant(Agent):
    def __init__(self) -> None:
        super().__init__(instructions="You are a helpful voice AI assistant.")

async def entrypoint(ctx: agents.JobContext):
    await ctx.connect()
        
    # Configure your AI agent session
    session = AgentSession(
        stt=deepgram.STT(model="nova-3", language="multi"),
        llm=openai.LLM(model="gpt-4o-mini"),
        tts=elevenlabs.TTS(
            voice_id="H8bdWZHK2OgZwTN7ponr",
            model="eleven_flash_v2_5",
            language="hi",  # Adjust language as needed
            voice_settings=elevenlabs.VoiceSettings(
                similarity_boost=1,
                stability=0.7,
                style=0.7,
                use_speaker_boost=False,
                speed=1.1
            )
        ),
        vad=silero.VAD.load(),
        turn_detection=MultilingualModel(),
    )
    
    # 🚀 Start Obsera Voice Analytics
    session_id = pype.start_session(
        session,
        phone_number="+1234567890",     # Optional: Customer phone number
        customer_name="John Doe",       # Optional: Customer name
        conversation_type="voice_call"  # Optional: Type of conversation
    )
    
    print(f"🎙️ Obsera Analytics started for session: {session_id}")

    # 📤 Export analytics data when session ends
    async def obsera_shutdown():
        try:
            result = await pype.export(
                session_id,
                recording_url=""  # Optional: Add recording URL if available
            )
            
            if result.get("success"):
                print("✅ Successfully exported to Obsera Voice Analytics!")
                print(f"📊 Log ID: {result.get('data', {}).get('log_id')}")
            else:
                print(f"❌ Export failed: {result.get('error')}")
                
        except Exception as e:
            print(f"💥 Export error: {e}")

    # Register cleanup callback
    ctx.add_shutdown_callback(obsera_shutdown)

    # Start the agent session
    await session.start(
        room=ctx.room,
        agent=Assistant(),
        room_input_options=RoomInputOptions(
            noise_cancellation=noise_cancellation.BVC(), 
        ),
    )

    # Generate initial greeting
    await session.generate_reply(
        instructions="Greet the user and offer your assistance."
    )

if __name__ == "__main__":
    agents.cli.run_app(agents.WorkerOptions(entrypoint_fnc=entrypoint))

🔧 Configuration

Required Environment Variables

Variable Description Where to Get
PYPE_API_KEY Your Obsera API authentication key Dashboard → API Keys

Agent Configuration

Replace "your-agent-id-from-dashboard" with your actual Agent ID from the Obsera dashboard:

pype = LivekitObserve(
    agent_id="2a72948a-094d-4a13-baf7-e033a5cdeb22"  # Your actual Agent ID
)

📊 Features

Automatic Metrics Collection

  • 🎙️ Speech-to-Text (STT): Audio duration, processing time
  • 🧠 Large Language Model (LLM): Token usage, response time, TTFT
  • 🗣️ Text-to-Speech (TTS): Character count, audio duration, TTFB
  • 👂 Voice Activity Detection (VAD): Voice detection metrics
  • ⏱️ End of Utterance (EOU): Turn-taking timing

Conversation Analytics

  • 📝 Full Transcript: Complete conversation history with timestamps
  • 🔄 Turn Tracking: User and agent turns with associated metrics
  • 📈 Performance Insights: Response times, token usage, audio quality
  • 🎯 Success Metrics: Call completion, lesson progress, handoff detection

Session Metadata

session_id = pype.start_session(
    session,
    phone_number="+1234567890",        # Customer contact
    customer_name="Jane Smith",        # Customer identification
    conversation_type="voice_call",    # Call type
    fpo_name="John Agent",            # Agent name
    lesson_day=3,                     # Custom metadata
    custom_field="any_value"          # Additional custom data
)

🔍 Advanced Usage

Manual Session Control

# Start session
session_id = pype.start_session(session, **metadata)

# Get current session data (without exporting)
current_data = pype.get_data(session_id)
print(f"Current metrics: {current_data}")

# Manually end session
pype.end(session_id)

# Export to Pype platform
result = await pype.export(session_id, recording_url="https://...")

📈 Dashboard Integration

Once your data is exported, view detailed analytics at: Obsera Voice Analytics Dashboard

Available Analytics:

  • 📊 Call Performance: Response times, success rates
  • 🎙️ Voice Quality: Audio metrics, clarity scores
  • 💬 Conversation Flow: Turn analysis, interruption patterns
  • 📈 Usage Statistics: Token consumption, API costs
  • 🎯 Business Metrics: Conversion rates, customer satisfaction

🛠️ Troubleshooting

Common Issues

1. "Session not found" Error

# Ensure session_id is stored correctly
session_id = pype.start_session(session)
print(f"Session ID: {session_id}")  # Save this for later use

2. "No data available" Error

# Make sure session has activity before exporting
await asyncio.sleep(1)  # Allow time for metrics collection
result = await pype.export(session_id)

3. API Authentication Error

# Check your .env file
echo $PYPE_API_KEY

# Ensure API key is set in environment
export PYPE_API_KEY="your_api_key_here"

Debug Mode

Enable verbose logging:

import logging
logging.basicConfig(level=logging.INFO)

# Your Pype code here - you'll see detailed logs

📝 Requirements

  • Python >= 3.8
  • LiveKit Agents >= 1.2.2
  • Active Obsera account with valid API key

🤝 Support

📄 License

MIT License - see LICENSE file for details.


Built with ❤️ by Obsera Voice Analytics

Transform your voice agents with professional analytics and insights.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

obsera-1.2.0.tar.gz (16.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

obsera-1.2.0-py3-none-any.whl (13.8 kB view details)

Uploaded Python 3

File details

Details for the file obsera-1.2.0.tar.gz.

File metadata

  • Download URL: obsera-1.2.0.tar.gz
  • Upload date:
  • Size: 16.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.10

File hashes

Hashes for obsera-1.2.0.tar.gz
Algorithm Hash digest
SHA256 89e9457ec2b6369f81372490d5b73b41b509239c51639c9aa175d63527400438
MD5 4430405355d4e1f9cfaf280b26752c97
BLAKE2b-256 00df0881c56a6822d494b92642e5eb1db4d34322519eede727b702d9284aae44

See more details on using hashes here.

File details

Details for the file obsera-1.2.0-py3-none-any.whl.

File metadata

  • Download URL: obsera-1.2.0-py3-none-any.whl
  • Upload date:
  • Size: 13.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.10

File hashes

Hashes for obsera-1.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 080c4dad5ab8284da5ce5243386e40597ac42afb692fc5ae904a7a629c3e7fb8
MD5 c893d4469f30020c1a856b04f1df0865
BLAKE2b-256 400c10ed7c99479bf7ce7f0f2715e29ee48101a9d27d62a4dba832cc22f69d30

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page