Skip to main content

CI reliability gate for AI agents

Project description

Praxis

Praxis is a CI reliability gate for AI agents. The MVP attacks every pull request with agent-specific task evals, runs checked-in regression cases, and surfaces generated failures for review.

The current implementation is a scaffolded MVP:

  • Python CLI distribution praxis-ai in packages/praxis-python
  • Next.js local dashboard in apps/dashboard
  • Deterministic black-box stubs for introspection, stress generation, and RCA
  • GitHub Action scaffolding for PR comments

Quick Start

make install
make test

Once published, install the CLI with:

pipx install praxis-ai
praxis --help

Run against a client repo with deterministic local behavior:

uv run praxis init --repo /path/to/demo-client-agent
uv run praxis run --repo /path/to/demo-client-agent --stub
uv run praxis generate-agent-tests --repo /path/to/demo-client-agent

Start the dashboard:

make dashboard-install
make dashboard

MVP Scope

Praxis currently treats introspection, adversarial generation, and RCA as replaceable stubs. The first real adapter targets the Python/LangGraph demo-client-agent.

Release

The PyPI distribution name is praxis-ai because praxis is already occupied on PyPI. The console command remains praxis.

Publishing uses PyPI Trusted Publishing from .github/workflows/publish.yml. Configure the PyPI project praxis-ai to trust this repository, workflow publish.yml, and environment pypi, then publish a GitHub release such as v0.1.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

praxis_ai-0.1.0.tar.gz (92.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

praxis_ai-0.1.0-py3-none-any.whl (11.1 kB view details)

Uploaded Python 3

File details

Details for the file praxis_ai-0.1.0.tar.gz.

File metadata

  • Download URL: praxis_ai-0.1.0.tar.gz
  • Upload date:
  • Size: 92.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for praxis_ai-0.1.0.tar.gz
Algorithm Hash digest
SHA256 6195a07131eb4db2bbd17eca82122ea63319bc5d52bd2af12139dfc9742c2f2c
MD5 d85ed1fb8ec9bb346962ec9ac9455c81
BLAKE2b-256 242c54ac1f62f565687ae6f40db9f9f468e1c513b54378ff74569db334fee8bc

See more details on using hashes here.

File details

Details for the file praxis_ai-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: praxis_ai-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 11.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.7

File hashes

Hashes for praxis_ai-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5a66fec7659ed691d728397d71d5a3a6075a8858235007619ca8b87ca0217dff
MD5 b3acbfe808cee26aac5940b8f0db927a
BLAKE2b-256 ef1b3e53b967c35cc5abb622c5c44a2d40ee2c10bc7bc29342dfff62feecd4c1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page