galtea 4.1.0rc4

Galtea software development kit

Galtea SDK

Comprehensive AI/LLM Testing & Evaluation Framework

Overview

Galtea SDK empowers AI engineers, ML engineers and data scientists to rigorously test and evaluate their AI products. With a focus on reliability and transparency, Galtea offers:

1. Automated Test Dataset Generation - Create comprehensive test datasets tailored to your AI product
2. Sophisticated Product Evaluation - Evaluate your AI products across multiple dimensions

Documentation

All SDK usage and API documentation has moved to our official docs: Galtea SDK Documentation

---

Development

This project uses Poetry for dependency management and packaging.

Development Setup

# Print the command to activate the virtual environment
poetry env activate

# Activate the virtual environment by copy-pasting the command
# Example: C:\Users\user\AppData\Local\pypoetry\Cache\virtualenvs\galtea-MmpOHh8e-py3.12\Scripts\activate.ps1

# Install dependencies
poetry install

Exit the virtual environment with exit command.

Running Tests

Tests are located in the tests/ directory and cover core functionality including file validation, string utilities, and model utilities.

Run All Tests

# Using Poetry (recommended)
poetry run pytest

# Or using Make
make test

# Using virtual environment directly
python -m pytest tests/

Run Tests with Verbose Output

poetry run pytest -v

Run Specific Test File

poetry run pytest tests/test_file_validation.py

Run Specific Test Class or Method

# Run a specific test class
poetry run pytest tests/test_file_validation.py::TestValidateKnowledgeBaseFile

# Run a specific test method
poetry run pytest tests/test_file_validation.py::TestValidateKnowledgeBaseFile::test_valid_txt_file

Run Tests with Coverage

poetry run pytest --cov=galtea --cov-report=html

This will generate a coverage report in the htmlcov/ directory.

Building the Project

To build the project:

poetry build

This will create distribution packages (wheel and source distribution) in the dist/ directory.

License

Apache License 2.0