Skip to main content

PyPI version CI codecov Docs Python 3.12+ License: Apache 2.0 Code style: ruff

CodeOptiX Logo

CodeOptiX

Agentic Code Optimization & Deep Evaluation for Superior Coding Agent Experience

CodeOptiX is the universal code optimization engine that improves coding agent experience with deep evaluations and optimization. When AI coding agents dazzle with impressive code but leave you wondering about quality, maintainability, security, and reliability, CodeOptiX ensures proper behavior through evaluations, reflection, and self-improvement. Powered by GEPA optimization and Bloom scenario generation.

Brought to you by Superagentic AI
Advancing AI agent optimization and autonomous systems

📚 Documentation


What is CodeOptiX?

CodeOptiX is the universal code optimization engine that improves coding agent experience with deep evaluations and optimization.

When AI coding agents dazzle with impressive code but leave you wondering about quality, maintainability, security, and reliability, CodeOptiX ensures proper behavior through evaluations, reflection, and self-improvement. Powered by GEPA optimization and Bloom scenario generation.

Built by Superagentic AI - Advancing the future of AI agent optimization and autonomous systems.

🚀 Key Capabilities

  • 🔍 Deep Behavioral Evaluation - Comprehensive testing against security, reliability, and quality behaviors
  • 🧬 GEPA Optimization Engine - Genetic-Pareto Evolution for automatic agent improvement
  • 🌸 Bloom-Style Scenario Generation - Intelligent test case creation for thorough evaluation
  • 🎯 Multi-Agent Support - Works with Claude Code, Codex, Gemini CLI, and custom agents
  • 🔧 Multi-Provider LLM Support - OpenAI, Anthropic, Google, and Ollama (local models included!)
  • ⚡ CI/CD Integration - Automated quality gates and GitHub Actions support

📋 Open Source Limitations

The open source version provides core evaluation capabilities. Advanced features like agent evolution and optimization have limited support. For full optimization capabilities tailored to your needs, please get in touch.


Quick Start

Installation

# Using uv (recommended)
uv pip install codeoptix

# Using pip
pip install codeoptix

Your First Evaluation

Option 1: Using Ollama (No API Key Required)

# Make sure Ollama is running
ollama serve

# Run evaluation with local model
codeoptix eval \
  --agent basic \
  --behaviors insecure-code \
  --llm-provider ollama

Option 2: Using Cloud Providers

# Set API key
export OPENAI_API_KEY="your-key-here"

# Run evaluation
codeoptix eval \
  --agent claude-code \
  --behaviors insecure-code \
  --llm-provider openai

Built-in Behaviors

Behavior Description
insecure-code Detects security vulnerabilities (SQL injection, XSS, hardcoded secrets)
vacuous-tests Identifies low-quality tests (missing assertions, trivial tests)
plan-drift Detects requirements misalignment and plan deviations
# Run multiple behaviors
codeoptix eval --behaviors insecure-code,vacuous-tests,plan-drift

Usage Modes

CLI Evaluation

codeoptix eval \
  --agent claude-code \
  --behaviors insecure-code \
  --llm-provider openai

CI/CD Integration

codeoptix ci \
  --agent codex \
  --behaviors insecure-code \
  --fail-on-failure

Python API

from codeoptix.adapters.factory import create_adapter
from codeoptix.evaluation import EvaluationEngine
from codeoptix.utils.llm import create_llm_client, LLMProvider

# Create adapter and evaluation engine
adapter = create_adapter("claude-code", config)
llm_client = create_llm_client(LLMProvider.OPENAI)
engine = EvaluationEngine(adapter, llm_client)

# Evaluate behaviors
results = engine.evaluate_behaviors(
    behavior_names=["insecure-code", "vacuous-tests"]
)

Development

Setup

# Clone the repository
git clone https://github.com/SuperagenticAI/codeoptix.git
cd codeoptix

# Install with uv (recommended)
uv sync --dev --extra docs

# Or with pip
pip install -e ".[dev,docs]"

Running Tests

# Run all tests
uv run pytest

# Run with coverage
uv run pytest --cov=codeoptix --cov-report=html

Code Quality

# Format code
uv run ruff format .

# Lint code
uv run ruff check .

# Install pre-commit hooks
uv run pre-commit install

Contributing

Contributions are welcome! Please see our Contributing Guide.

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Make your changes
  4. Run tests and linting (uv run pytest && uv run ruff check .)
  5. Commit your changes (git commit -m 'Add amazing feature')
  6. Push to the branch (git push origin feature/amazing-feature)
  7. Open a Pull Request

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.


Support


🤖 About Superagentic AI

CodeOptiX is proudly built by Superagentic AI

Advancing AI agent optimization and autonomous systems for the future of software development.

🌟 Our Mission

We're building the next generation of AI tools that enhance developer productivity and code quality through intelligent agent optimization.

🚀 Explore More

Release files for codeoptix 0.1.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for codeoptix 0.1.4
File Size Uploaded
codeoptix-0.1.4.tar.gz 152.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for codeoptix 0.1.4
File Interpreter ABI Platform
codeoptix-0.1.4-py3-none-any.whl Python 3 none any Details

Total release size: 372.3 kB

Release files / codeoptix-0.1.4.tar.gz

Download URL codeoptix-0.1.4.tar.gz
Size 152.3 kB
Tags Source
SHA-256 checksum
How to use checksums
0efafda75d7eaae1eb51469187c743d7f62b0eff87a14953dcdd985c83b06651
BLAKE2b-256 checksum
How to use checksums
de7f1a863f7b97dc14fc7598980fc00cec09dbbb7a46c3bacf1cfc3f06df649f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.13 {"installer":{"name":"uv","version":"0.12.13","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / codeoptix-0.1.4-py3-none-any.whl

Download URL codeoptix-0.1.4-py3-none-any.whl
Size 220.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
10c5a7d3509971022f8d64fd3a96924d0f09747d9d200e6cc516701fdf535217
BLAKE2b-256 checksum
How to use checksums
de6b233e4bde63c8dfdf80dd2a9055d7a912d4c9c53935b285ed8c5dce35a237
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.13 {"installer":{"name":"uv","version":"0.12.13","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

This release

0.1.4 This release

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page