galtea 3.1.0rc2

Galtea software development kit

Galtea SDK

Comprehensive AI/LLM Testing & Evaluation Framework

Overview

Galtea SDK empowers AI engineers, ML engineers and data scientists to rigorously test and evaluate their AI products. With a focus on reliability and transparency, Galtea offers:

1. Automated Test Dataset Generation - Create comprehensive test datasets tailored to your AI product
2. Sophisticated Product Evaluation - Evaluate your AI products across multiple dimensions

Documentation

All SDK usage and API documentation has moved to our official docs: Galtea SDK Documentation

---

Development

This project uses Poetry for dependency management and packaging.

Development Setup

# Print the command to activate the virtual environment
poetry env activate

# Activate the virtual environment by copy-pasting the command
# Example: C:\Users\user\AppData\Local\pypoetry\Cache\virtualenvs\galtea-MmpOHh8e-py3.12\Scripts\activate.ps1

# Install dependencies
poetry install

Exit the virtual environment with exit command.

Running Tests

Tests are located in the tests/ directory. To run all tests:

poetry run pytest

Building the Project

To build the project:

poetry build

This will create distribution packages (wheel and source distribution) in the dist/ directory.

License

Apache License 2.0