A Python package for extracting and managing logs to build a collaborative workspace for agents
Project description
Neatlogs Python SDK
The official Python SDK for Neatlogs - a collaborative debugging platform for AI agents and LLM applications.
What is Neatlogs?
Neatlogs helps your team debug AI agents faster and more effectively by bringing developers and domain experts together for collaborative debugging. Unlike traditional observability tools, Neatlogs is designed from the ground up for team collaboration on AI agent debugging.
Key Features
- 🔍 Agent Trace Debugging: Crystal-clear visualization of agent thoughts, tool calls, and decisions
- 💬 Collaborative Comments: Team members can comment directly on specific parts of agent traces
- 📊 Smart Evaluations: Quick feedback system with actionable insights
- 📋 AI-Powered Task Management: Convert discussions into trackable tasks automatically
- 🔧 Easy Integration: Just 2 lines of code to get started
Why Choose Neatlogs?
The Problem with AI Agent Debugging
Unlike regular code where errors scream at you, AI agents are mysterious. When your agent gives puzzling results, you need to:
- Analyze the output - What did it actually produce?
- Examine the trace - Step-by-step log of thoughts and actions
- Find the root cause - Usually issues with prompts or tools
How Neatlogs Solves This
- ❌ No More Vague Feedback: Skip the spreadsheet chaos - collaborate directly on agent traces
- ✅ Actionable Fixes: Turn evaluations and discussions into clear, actionable tasks
- 🎯 Everything in One Place: No more hunting for context across Slack, email, and docs
- 🚀 2x Faster Development: Teams often ship reliable AI agents twice as fast
Neatlogs vs. Traditional Observability
| Traditional Tools | Neatlogs |
|---|---|
| Developer-only focus | Built for team collaboration |
| Technical UI only | Non-technical friendly |
| Show what happened | Help understand why + how to fix |
| Scattered feedback | Centralized discussions |
Quick Start
Installation
pip install neatlogs
Basic Usage
import neatlogs
# Initialize with your Project API Key
neatlogs.init("your-project-api-key-here")
# Your existing AI agent code works unchanged!
# Neatlogs automatically captures LLM calls
Get Your Project API Key
- Visit app.neatlogs.com
- Create a new project
- Copy your Project API Key
- Use it in the
neatlogs.init()call
Supported Frameworks
CrewAI Integration
Neatlogs offers seamless integration with CrewAI for multi-agent applications:
In your main.py add this
import neatlogs
# Initialize Neatlogs before creating your crew
neatlogs.init("your-project-api-key")
# All agent interactions are automatically traced
Advanced Features
Adding Tags
Organize your traces with custom tags:
import neatlogs
# Initialize tracker
tracker = neatlogs.init("your-project-api-key")
# Add tags to categorize traces
tracker.add_tags(["production", "customer-support", "v2.1"])
# All subsequent LLM calls will be tagged
What Gets Tracked?
Neatlogs automatically captures:
- 💭 Agent Thoughts: The reasoning process before actions
- 🛠️ Tool Calls: API calls, function executions, and their results
- 🔄 Multi-Agent Interactions: Task delegations and handoffs
- 📝 Prompts & Responses: Complete conversation history
- ⚠️ Errors: Detailed error information and stack traces
- 📊 Usage Statistics: Token counts and performance metrics
Platform Features
Once your traces are captured, use the Neatlogs platform to:
🔍 Trace Analysis
- Clean UI: No more endless scrolling through logs
- Error Highlighting: Automatically spot issues
- AI Summaries: Get quick overviews of complex traces
- Step Navigation: Jump between agent actions effortlessly
💬 Team Collaboration
- Pinpoint Comments: Comment on specific trace steps
- Context Preservation: Full conversation history in one place
- Real-time Notifications: Stay updated on team feedback
- Domain Expert Friendly: Non-technical team members can contribute
📊 Smart Evaluations
- Quick Feedback: Mark responses as Correct/Incorrect/Mixed
- Bulk Operations: Evaluate multiple traces efficiently
- Filter & Search: Find specific traces instantly
- Export Options: Download evaluation data
📋 Task Management
- AI-Generated Tasks: Convert comment threads to actionable items
- Kanban Board: Visual task tracking
- Smart Suggestions: AI recommends solutions based on context
- Team Assignment: Distribute work effectively
Requirements
- Python 3.8+
- LiteLLM 1.3.1+ (for LLM call tracking)
- Active internet connection (for trace upload)
Links
- Website: neatlogs.com
- Documentation: docs.neatlogs.com
- Dashboard: app.neatlogs.com
- Support: GitHub Issues
FAQ
Q: Do I need to change my existing code?
A: No! Just add neatlogs.init() and your existing LLM calls are automatically tracked.
Q: Can I use this in production? A: Yes! Neatlogs is designed for production use with minimal performance impact.
Q: What LLM providers are supported? A: Any provider supported by LiteLLM (OpenAI, Anthropic, Azure, local models, etc.)
Contributing
We welcome contributions! Please see our contributing guidelines for details.
License
This project is licensed under the MIT License - see the LICENSE file for details.
Support
Having issues? We're here to help!
- 📧 Email: hello@neatlogs.com
- 📖 Docs: docs.neatlogs.com
- 🐛 Issues: GitHub Issues
Ready to debug your AI agents like a pro?
Start with just 2 lines of code:
import neatlogs
neatlogs.init("your-project-api-key")
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file neatlogs-0.8.0.tar.gz.
File metadata
- Download URL: neatlogs-0.8.0.tar.gz
- Upload date:
- Size: 16.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
656583c94374be3fc5c8c2ab522db79e3e6c179e158f07d58b0f5b276bf39a64
|
|
| MD5 |
154a580ed2e52d565f7790145c8cc623
|
|
| BLAKE2b-256 |
17cda560f952482812e58b1f296d5fb14b7dcf4a170aa1bd4324c8676f5d4d1f
|
File details
Details for the file neatlogs-0.8.0-py3-none-any.whl.
File metadata
- Download URL: neatlogs-0.8.0-py3-none-any.whl
- Upload date:
- Size: 16.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
348652bb1198a4ee4aae439c7b0e0338be64919176eb1e4a0fe8c8c475ed4e20
|
|
| MD5 |
ee23a48af22d5cbffcc71718540d4661
|
|
| BLAKE2b-256 |
38bdef79145f6c2923883895a9d2a4788479eb20ef71a7259785dfc737e593a6
|