Skip to main content

Tool for testing AI system prompts against various attack vectors

Project description

Compliant LLM

PyPI Documentation Discord Chat GitHub Stars YC LinkedIn Follow on X Commit Activity Issues Closed License

Compliant LLM is your comprehensive toolkit for ensuring compliance and security of your AI systems.

Infosec, compliance, and gen AI teams use compliant-llm to ensure that their AI agents are secure and compliant with internal policies and frameworks like NIST, ISO, HIPAA, GDPR, etc.

It supports multiple LLM providers, and can be used to test prompts, agents, MCP servers and GenAI models.

Go through our documentation for more details.

Report a Bug

Request a Feature

🎯 Key Features

  • 🎯 Security Testing: Test against 8+ attack strategies including prompt injection, jailbreaking, and context manipulation
  • 📊 Compliance Analysis: Ensure the compliance of your AI systems against NIST, ISO, OWASP, GDPR, HIPAA and other compliance frameworks
  • 🤖 Provider Support: Works with multiple LLM providers via LiteLLM
  • 📈 Visual Dashboard: Interactive UI for analyzing test results
  • End to End Testing: Test your AI systems end to end
  • 📄 Detailed Reporting: Comprehensive reports with actionable insights

⚙️ Installation

pip install compliant-llm

Connect to your LLM

Initialize the API key(s) and configuration to access the target LLM

# for openai models:
export OPENAI_API_KEY=your-api-key-here

# anthropic models:
export ANTHROPIC_API_KEY=your-api-key-here

# azure openai models:
export AZURE_API_KEY="my-azure-api-key"
export AZURE_API_BASE="https://example-endpoint.openai.azure.com"
export AZURE_API_VERSION="2023-05-15"

🚀 Quick Start

  1. You can use the compliant-llm dashboard:
compliant-llm dashboard
  1. Or use the CLI:
compliant-llm test --prompt "You are a helpful assistant who can only respond ethically" --strategy "prompt_injection,jailbreak" --provider="azure/gpt-4o"
  1. Or use a configuration file:
compliant-llm test --config_path configs/config.yaml
  1. View the latest test report in UI:
compliant-llm dashboard

Support

Create Issue

Contact: founders@fiddlecube.ai

Meet: 🔗 Find a slot

Community: 💬 Discord, X, LinkedIn

Self-hosted or hosted cloud: Book a demo

🔗 Book a slot

Roadmap

  • Full Application Pen Testing
  • Compliant and Logged MCP Servers
  • Support different Compliance Frameworks - NIST, HIPAA, GDPR, EU AI Act, etc.
  • Multimodal Testing
  • CI/CD
  • Access Control checks
  • Control Pane for different controls
  • Internal audits and documentation

⭐️ Star us

🤝 Contributors

Developers Contributors
Those who build with compliant-llm. Those who make compliant-llm better.
(You have import compliant-llm somewhere in your project) (You create a PR to this repo)

We welcome contributions from the community! Whether it's bug fixes, feature additions, or documentation improvements, your input is valuable.

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

🔒 Security & Privacy

We take data security and privacy seriously. Please refer to our Security and Privacy page for more information.

Telemetry

Compliant LLM tracks anonymized usage statistics to improve the product. No private or personally identifiable information is tracked.

You can opt-out by setting export DISABLE_COMPLIANT_LLM_TELEMETRY=true.

📝 Cite Us

@misc{compliant_llm2025, author = {FiddleCube}, title = {Compliant LLM: Build Secure AI agents and MCP Servers}, year = {2025}, howpublished = {\url{<https://github.com/fiddlecube/compliant-llm}}>, }

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

compliant_llm-0.1.6.tar.gz (342.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

compliant_llm-0.1.6-py3-none-any.whl (382.7 kB view details)

Uploaded Python 3

File details

Details for the file compliant_llm-0.1.6.tar.gz.

File metadata

  • Download URL: compliant_llm-0.1.6.tar.gz
  • Upload date:
  • Size: 342.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for compliant_llm-0.1.6.tar.gz
Algorithm Hash digest
SHA256 44f8f1d1bff08bded8f140a95ab16ad32def961023608a897eaa21a52f3ce3ed
MD5 50cc0787e70021614d434aa289dc6306
BLAKE2b-256 1991ecf1aa0d060d5326add47402575d6eb900fcb9dd6117f464782e64c35f69

See more details on using hashes here.

Provenance

The following attestation bundles were made for compliant_llm-0.1.6.tar.gz:

Publisher: publish-to-pypi.yml on fiddlecube/compliant-llm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file compliant_llm-0.1.6-py3-none-any.whl.

File metadata

  • Download URL: compliant_llm-0.1.6-py3-none-any.whl
  • Upload date:
  • Size: 382.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for compliant_llm-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 7e7c1b32edd2273fb000b2572a51bffd1e38475efc35ca787cab9a367fc80a5d
MD5 91285e33d2b8a1a32301103ebc953a1a
BLAKE2b-256 6942721bf08536af4652084e1ce0d76c2ee7b47ee881b1bb73104b8137a0b29c

See more details on using hashes here.

Provenance

The following attestation bundles were made for compliant_llm-0.1.6-py3-none-any.whl:

Publisher: publish-to-pypi.yml on fiddlecube/compliant-llm

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page