Tool for testing AI system prompts against various attack vectors
Project description
Compliant LLM is your comprehensive toolkit for ensuring compliance and security of your AI systems.
Infosec, compliance, and gen AI teams use compliant-llm to ensure that their AI agents are secure and compliant with internal policies and frameworks like NIST, ISO, HIPAA, GDPR, etc.
It supports multiple LLM providers, and can be used to test prompts, agents, MCP servers and GenAI models.
Go through our documentation for more details.
🎯 Key Features
- 🎯 Security Testing: Test against 8+ attack strategies including prompt injection, jailbreaking, and context manipulation
- 📊 Compliance Analysis: Ensure the compliance of your AI systems against NIST, ISO, OWASP, GDPR, HIPAA and other compliance frameworks
- 🤖 Provider Support: Works with multiple LLM providers via LiteLLM
- 📈 Visual Dashboard: Interactive UI for analyzing test results
- ⚡ End to End Testing: Test your AI systems end to end
- 📄 Detailed Reporting: Comprehensive reports with actionable insights
⚙️ Install and Run
# install
pip install compliant-llm
# run the dashboard
compliant-llm dashboard
Configure your LLM provider and run attacks
Support
Contact: founders@fiddlecube.ai
Meet: 🔗 Find a slot
Community: 💬 Discord, X, LinkedIn
Self-hosted or hosted cloud: Book a demo
Supported Providers
- OpenAI
- Anthropic
- Gemini
- Mistral
- Groq
- Deepseek
- Azure
- vLLM Ollama
- Ollama
- Nvidia Nim
- Meta Llama
Roadmap
- Full Application Pen Testing
- Compliant and Logged MCP Servers
- Support different Compliance Frameworks - NIST, HIPAA, GDPR, EU AI Act, etc.
- Multimodal Testing
- CI/CD
- Access Control checks
- Control Pane for different controls
- Internal audits and documentation
⭐️ Star us
🤝 Contributors
| Developers | Contributors |
|---|---|
Those who build with compliant-llm. |
Those who make compliant-llm better. |
(You have import compliant-llm somewhere in your project) |
(You create a PR to this repo) |
We welcome contributions from the community! Whether it's bug fixes, feature additions, or documentation improvements, your input is valuable.
- Fork the repository
- Create your feature branch (git checkout -b feature/AmazingFeature)
- Commit your changes (git commit -m 'Add some AmazingFeature')
- Push to the branch (git push origin feature/AmazingFeature)
- Open a Pull Request
🔒 Security & Privacy
We take data security and privacy seriously. Please refer to our Security and Privacy page for more information.
Telemetry
Compliant LLM tracks anonymized usage statistics to improve the product. No private or personally identifiable information is tracked.
You can opt-out by setting export DISABLE_COMPLIANT_LLM_TELEMETRY=true.
📝 Cite Us
@misc{compliant_llm2025, author = {FiddleCube}, title = {Compliant LLM: Build Secure AI agents and MCP Servers}, year = {2025}, howpublished = {\url{<https://github.com/fiddlecube/compliant-llm}}>, }
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file compliant_llm-0.1.8.tar.gz.
File metadata
- Download URL: compliant_llm-0.1.8.tar.gz
- Upload date:
- Size: 344.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
26d515ccca64b74b5b75293562d55044566a97a169e35d53b622eb1306cd63a6
|
|
| MD5 |
aedb2b52aad808eb31fc588066a4d01f
|
|
| BLAKE2b-256 |
e30620946520fc7e35828599bfc97cd297f0722c62bec4aed13d324d1f6436f1
|
Provenance
The following attestation bundles were made for compliant_llm-0.1.8.tar.gz:
Publisher:
publish-to-pypi.yml on fiddlecube/compliant-llm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
compliant_llm-0.1.8.tar.gz -
Subject digest:
26d515ccca64b74b5b75293562d55044566a97a169e35d53b622eb1306cd63a6 - Sigstore transparency entry: 227991516
- Sigstore integration time:
-
Permalink:
fiddlecube/compliant-llm@920bd4cddec88a52741486db7eb9736ffd9d6a35 -
Branch / Tag:
refs/tags/v0.1.8 - Owner: https://github.com/fiddlecube
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-to-pypi.yml@920bd4cddec88a52741486db7eb9736ffd9d6a35 -
Trigger Event:
push
-
Statement type:
File details
Details for the file compliant_llm-0.1.8-py3-none-any.whl.
File metadata
- Download URL: compliant_llm-0.1.8-py3-none-any.whl
- Upload date:
- Size: 386.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
db9b9352634cec5591def30dec52ca83748fe8b62b4be04d6e3f69fa4090bee0
|
|
| MD5 |
949819b4743e3959706665d89dad83f5
|
|
| BLAKE2b-256 |
8ccad464c40fae7bebd9521dd62f1ef3067cb620cb2dc04026a15c9288157a72
|
Provenance
The following attestation bundles were made for compliant_llm-0.1.8-py3-none-any.whl:
Publisher:
publish-to-pypi.yml on fiddlecube/compliant-llm
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
compliant_llm-0.1.8-py3-none-any.whl -
Subject digest:
db9b9352634cec5591def30dec52ca83748fe8b62b4be04d6e3f69fa4090bee0 - Sigstore transparency entry: 227991523
- Sigstore integration time:
-
Permalink:
fiddlecube/compliant-llm@920bd4cddec88a52741486db7eb9736ffd9d6a35 -
Branch / Tag:
refs/tags/v0.1.8 - Owner: https://github.com/fiddlecube
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish-to-pypi.yml@920bd4cddec88a52741486db7eb9736ffd9d6a35 -
Trigger Event:
push
-
Statement type: