Skip to main content

Rhesis SDK 🧠

License PyPI Version Python Versions Discord LinkedIn Hugging Face Documentation

Your team defines expectations, Rhesis generates and executes thousands of test scenarios. So that you know what you ship.

The Rhesis SDK empowers developers to programmatically access curated test sets and generate comprehensive test scenarios for Gen AI applications. Transform domain expertise into automated testing: access thousands of test scenarios, generate custom validation suites, and integrate seamlessly into your workflow to keep your Gen AI robust, reliable & compliant.

Rhesis Platform Results

📑 Table of Contents

✨ Features

The Rhesis SDK provides programmatic access to the Rhesis testing platform:

  • Access Test Sets: Browse and load curated test sets across multiple domains and use cases
  • Generate Test Scenarios: Create custom test sets from prompts, requirements, or domain knowledge
  • Seamless Integration: Integrate testing into your CI/CD pipeline and development workflow
  • Comprehensive Coverage: Scale your testing from dozens to thousands of scenarios
  • Open Source: MIT-licensed with full transparency and community-driven development

🚀 Installation

Install the Rhesis SDK using pip:

pip install rhesis-sdk

🐍 Python Requirements

Rhesis SDK requires Python 3.10 or newer.

🏁 Getting Started

1. Obtain an API Key 🔑

  1. Visit https://app.rhesis.ai
  2. Sign up for a Rhesis account
  3. Navigate to your account settings
  4. Generate a new API key

Your API key will be in the format rh-XXXXXXXXXXXXXXXXXXXX. Keep this key secure and never share it publicly.

Note: On the Rhesis App, you can also create test sets for your own use cases and access them via the SDK. You only need to connect your GitHub account to create a test set.

2. Configure and use the SDK.

from pprint import pprint

from rhesis.sdk.entities import TestSet
from rhesis.sdk.synthesizers import PromptSynthesizer

os.environ["RHESIS_API_KEY"] = "rh-your-api-key"  # Get from app.rhesis.ai settings
os.environ["RHESIS_BASE_URL"] = "https://api.rhesis.ai"  # optional

# Browse available test sets
for test_set in TestSet().all():
    pprint(test_set)

# Generate custom test scenarios
synthesizer = PromptSynthesizer(
    prompt="Generate tests for a medical chatbot that must never provide diagnosis"
)
test_set = synthesizer.generate(num_tests=10)
pprint(test_set.tests)

Generating Custom Test Sets 🛠️

If none of the existing test sets fit your needs, you can generate your own. You can check out app.rhesis.ai. There you can define requirements, scenarios and expected behaviors.

🧪 About Rhesis AI

Rhesis is an open-source testing platform that transforms how Gen AI teams validate their applications. Through collaborative test management, domain expertise becomes comprehensive automated testing: legal defines requirements, marketing sets expectations, engineers build quality, and everyone knows exactly how the Gen AI application performs before users do.

Key capabilities:

  • Collaborative Test Management: Your entire team contributes requirements without writing code
  • Automated Test Generation: Generate thousands of test scenarios from team expertise
  • Comprehensive Coverage: Scale from dozens of manual tests to thousands of automated scenarios
  • Edge Case Discovery: Find potential failures before your users do
  • Compliance Validation: Ensure systems meet regulatory and ethical standards

Made in Potsdam, Germany 🇩🇪

Visit rhesis.ai to learn more about our platform and services.

👥 Community 💬

Join our Discord server to connect with other users and developers.

🤗 Hugging Face

You can also find us on Hugging Face. There, you can find our test sets across multiple use cases.

🆘 Support

For questions, issues, or feature requests:

📝 License

The Rhesis SDK is licensed under the MIT License - see the LICENSE file for details.

The SDK is completely open-source and freely available for use, modification, and distribution.


Made with ❤️ in Potsdam, Germany 🇩🇪

Learn more at rhesis.ai

Metadata

Release files for rhesis-sdk 0.15.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for rhesis-sdk 0.15.2
File Size Uploaded
rhesis_sdk-0.15.2.tar.gz 832.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for rhesis-sdk 0.15.2
File Interpreter ABI Platform
rhesis_sdk-0.15.2-py3-none-any.whl Python 3 none any Details

Total release size: 1.4 MB

Release files / rhesis_sdk-0.15.2.tar.gz

Download URL rhesis_sdk-0.15.2.tar.gz
Size 832.3 kB
Tags Source
SHA-256 checksum
How to use checksums
73c6fb9803d2c105ab1287098381baa9b692ca5ee8ff3a9bf950c48e69bac1e4
BLAKE2b-256 checksum
How to use checksums
5c5fb01c41a2162aee020f96a8872332e106b9b800955490284bf46fa1275d6e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 16, 2026.

Transparency log

Release files / rhesis_sdk-0.15.2-py3-none-any.whl

Download URL rhesis_sdk-0.15.2-py3-none-any.whl
Size 612.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7fbb0d9b75d1d0f9ec305466fdd4928ea4108d8e2b25c9d78fe613c26ae60811
BLAKE2b-256 checksum
How to use checksums
953de0007f298049e85a92548b3363d4fc520558c94cdd0c38c83b91ab3dd098
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 16, 2026.

Transparency log

Release history Release notifications | RSS feed

0.17.1

2 release files

0.17.0

2 release files

0.16.0

2 release files

This release

0.15.2 This release

2 release files

0.14.0

2 release files

0.13.0

2 release files

0.11.0

2 release files

0.10.0

2 release files

0.9.1

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.11

2 release files

0.6.10

2 release files

0.6.9

2 release files

0.6.8

2 release files

0.6.7

2 release files

0.6.6

2 release files

0.6.5

2 release files

0.6.4

2 release files

0.6.3

2 release files

0.6.2

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.2

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.2

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.4

2 release files

0.2.3

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

0.1.9

2 release files

0.1.8

2 release files

0.1.7

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page