agentneo 1.0.0b0

A powerful tracing library for monitoring and analyzing AI agents, LLM calls, and tool interactions.

AgentNeo

Empower Your AI Applications with Unparalleled Observability and Optimization

AgentNeo is an advanced, open-source Agentic AI Application Observability, Monitoring, and Evaluation Framework. Designed to elevate your AI development experience, AgentNeo provides deep insights into your AI agents, Large Language Model (LLM) calls, and tool interactions. By leveraging AgentNeo, you can build more efficient, cost-effective, and high-quality AI-driven solutions.

Whether you're a seasoned AI developer or just starting out, AgentNeo offers robust logging, visualization, and evaluation capabilities to help you debug and optimize your applications with ease.

🚀 Key Features

• Trace LLM Calls: Monitor and analyze LLM calls from various providers like OpenAI and LiteLLM.
• Trace Agents and Tools: Instrument and monitor your agents and tools to gain deeper insights into their behavior.
• Monitor Interactions: Keep track of tool and agent interactions to understand system behavior.
• Detailed Metrics: Collect comprehensive metrics on token usage, costs, and execution time.
• Flexible Data Storage: Store trace data in SQLite databases and JSON log files for easy access and analysis.
• Simple Instrumentation: Utilize easy-to-use decorators to instrument your code without hassle.
• Interactive Dashboard: Visualize trace data and execution graphs in a user-friendly dashboard.
• Project Management: Manage multiple projects seamlessly within the framework.
• Execution Graph Visualization: Gain insights into your application's flow with detailed execution graphs.
• Evaluation Tools: Assess and improve your AI agent's performance with built-in evaluation tools.

🛠 Requirements

• Python: Version 3.8 or higher
• Node.js: Version 14 or higher
• npm: Version 6 or higher (or yarn 1.22+ as an alternative)

📦 Installation

Install AgentNeo effortlessly using pip:

pip install agentneo

Install Node.js and npm (or yarn)

The dashboard component requires Node.js and npm/yarn. Follow these steps to install them:

• Node.js and npm: Visit nodejs.org and download the installer for your operating system.

• yarn (optional): If you prefer yarn over npm, install it globally after Node.js:

  npm install -g yarn
  

Verify the Installations

Ensure that Node.js and npm/yarn are correctly installed:

node --version
npm --version  # or yarn --version

Note: AgentNeo will attempt to install the necessary React dependencies automatically when you launch the dashboard for the first time.

🌟 Quick Start Guide

Get up and running with AgentNeo in just a few steps!

1. Import the Necessary Components

from agentneo import AgentNeo, Tracer, Evaluation, launch_dashboard

2. Create a Session and Project

neo_session = AgentNeo(session_name="my_session")
neo_session.create_project(project_name="my_project")

3. Initialize the Tracer

tracer = Tracer(session=neo_session, log_file_path="trace.json")
tracer.start()

4. Instrument Your Code

Wrap your functions with AgentNeo's decorators to start tracing:

@tracer.trace_llm("my_llm_call")
async def my_llm_function():
    # Your LLM call here
    pass

@tracer.trace_tool("my_tool")
def my_tool_function():
    # Your tool logic here
    pass

@tracer.trace_agent("my_agent")
def my_agent_function():
    # Your agent logic here
    pass

5. Stop Tracing and Launch the Dashboard

tracer.stop()

launch_dashboard(port=3000)

Access the interactive dashboard by visiting http://localhost:3000 in your web browser.

🔧 Advanced Usage

Project Management

Manage multiple projects with ease.

• List All Projects

  projects = neo_session.list_projects()
  

• Connect to an Existing Project

  neo_session.connect_project(project_name="existing_project")
  

Execution Graph Visualization

AgentNeo generates an execution graph that visualizes the flow of your AI application, including LLM calls, tool usage, and agent interactions. Explore this graph in the interactive dashboard to gain deeper insights.

📊 Dashboard Overview

The AgentNeo dashboard offers a comprehensive view of your AI application's performance:

• Project Overview
• System Information
• LLM Call Statistics
• Tool and Agent Interaction Metrics
• Execution Graph Visualization
• Timeline of Events

Launching the Dashboard

from agentneo import launch_dashboard
launch_dashboard(port=3000)

Note: The first time you launch the dashboard, AgentNeo will install necessary React dependencies. This may take a few moments.

🛣️ Roadmap

We are committed to continuously improving AgentNeo. Here's a glimpse of what's on the horizon:

Feature	Status
Local Data Storage Improvements	✅ Completed
Support for Additional LLMs	🔄 In Progress
Integration with AutoGen	🔄 In Progress
Integration with CrewAI	🔄 In Progress
Integration with Langraph	🔄 In Progress
Comprehensive Logging Enhancements	🔄 In Progress
Custom Agent Orchestration Support	🔜 Coming Soon
Advanced Error Detection Tools	🔜 Coming Soon
Multi-Agent Framework Visualization	🔜 Coming Soon
Performance Bottleneck Identification	🔜 Coming Soon
Code Execution Sandbox	🔜 Coming Soon
Prompt Caching for Latency Reduction	📝 Planned
Real-Time Guardrails Implementation	📝 Planned
Open-Source Agentic Apps Integration	📝 Planned
Security Checks and Jailbreak Detection	📝 Planned
Regression Testing Capabilities	📝 Planned
Agent Battleground for A/B Testing	📝 Planned
IDE Plugins Development	📝 Planned

Legend

• ✅ Completed
• 🔄 In Progress
• 🔜 Coming Soon
• 📝 Planned

💡 Troubleshooting

Encountering issues? Here are some common solutions:

1. Node.js and npm Accessibility: Ensure Node.js and npm are installed and accessible from the command line.
2. Permission Issues: If you face permission errors during dependency installation, try running your script with administrator/root privileges.
3. Check Error Messages: Review the console output for any error messages related to Node.js, npm, or dependency installations.

📚 Documentation

Dive deeper into AgentNeo's capabilities by visiting our official documentation.

🤝 Contributing

We warmly welcome contributions from the community! Whether it's reporting bugs, suggesting new features, or improving documentation, your input is invaluable.

• GitHub Repository: github.com/aristotle-ai/ragaai-agentneo
• Contribution Guidelines: Check out our contribution guidelines on GitHub to get started.

Join us in making AgentNeo even better!

📄 License