janus-python-sdk 0.2.9a3

Automatically stress-test your AI apps. Sign up for an api key at withjanus.com

Janus Python SDK Documentation

This repository contains the official documentation for the Janus Python SDK - a comprehensive AI agent testing and evaluation framework.

What is Janus?

Janus Python SDK helps you build, test, and evaluate AI applications through automated conversations, function call tracing, and rule-based evaluation. It's designed to stress-test your AI agents with thousands of conversations, each simulating different personalities, intents, and edge cases.

Key Features

• Automated Testing: Run multiple conversation simulations with different personas
• Function Tracing: Track every function call and tool usage automatically
• Performance Evaluation: Enforce domain-specific rules and monitor custom KPIs
• Hallucination Detection: Validate agent responses against your knowledge base
• Framework Integration: Works seamlessly with popular frameworks like LangChain

Quick Start

1. Install the SDK:

   pip install janus-python-sdk
   

2. Get an API Key: Contact [e-mail]

3. Run Your First Test: Follow our quickstart guide to test your first AI agent in under 5 minutes

Documentation Structure

• Getting Started: Overview and introduction to Janus
• Quickstart: Get up and running in 5 minutes
• Installation: Setup and configuration guide
• Core Concepts: Understanding agent testing, tracing, and evaluation
• API Reference: Complete SDK documentation
• Webapp Setup: Configuring your testing environment
• Support: Get help and contact information

Development

This documentation is built with Mintlify. To preview changes locally:

npm i -g mint
mint dev

Need Help?

• Documentation: Browse the guides above
• Support: Email [e-mail]
• Dashboard: Access your results at app.withjanus.com

Contributing

Found an issue or want to improve the documentation? Please open an issue or submit a pull request.