Red Teaming python-framework for testing chatbots and GenAI systems
Install 🚀
pip install llamator==3.5.0
Documentation 📚
Documentation Link: https://LLAMATOR-Core.github.io/llamator
Guides ▶️
Examples 💡
- 📄 RAG bot testing via REST API
- 🧙♂️ Gandalf web bot testing via Selenium
- 💬 Telegram bot testing via Telethon
- 📱 WhatsApp bot testing via Selenium
- 🔗 LangChain client testing with custom attack
- 📷 Vision Model testing via LangChain
- 🐋 Running LLAMATOR in Docker
Supported Clients 🛠️
- 🌐 All LangChain clients
- 🧠 OpenAI-like API
- ⚙️ Custom Class (Telegram, WhatsApp, Selenium, etc.)
Unique Features 🌟
- ️🗡 Support for custom attacks and datasets from the user
- 👜 Large selection of attacks on LLMs, RAGs, Agents, VLMs in English and Russian
- 🛡 Custom configuration of chat clients
- 📊 History of attack requests and responses in Excel and CSV format
- 📄 Test report document in DOCX format
OWASP Classification 🔒
- 💉 LLM01: Prompt Injection and Jailbreaks
- 🕵️♀️ LLM07: System Prompt Leakage
- 🤥 LLM09: Misinformation
- 💸 LLM10: Unbounded Consumption
Community 🌍
- 💬 Telegram Chat — LLAMATOR | AI Red Team Community
- 🖤 Supported by AI Talent Hub and ITMO University
Contacts 📬
✉️ Email: team@llamator.org
Enterprise Version 🏢
⚡️Coming Soon⚡️
License 📜
© Roman Neronov, Timur Nizamov, Nikita Ivanov
This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.
Metadata
Release files for llamator 3.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| llamator-3.5.0.tar.gz | 1.5 MB | Without provenance | Details for llamator-3.5.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| llamator-3.5.0-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details for llamator-3.5.0-py2.py3-none-any.whl |
Total release size: 3.0 MB
Release files / llamator-3.5.0.tar.gz
| Download URL | llamator-3.5.0.tar.gz |
|---|---|
| Size | 1.5 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9a25f0f7daf0a6ef02f2b6fda72c3f357424a348173bd8cf6649ebb28815d602
|
|
BLAKE2b-256 checksum How to use checksums |
d88cbbe3587bc82b01a872c0f59932024da5f2108991c7481fe64c65b1c102c3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.11
|
Release files / llamator-3.5.0-py2.py3-none-any.whl
| Download URL | llamator-3.5.0-py2.py3-none-any.whl |
|---|---|
| Size | 1.5 MB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
77ce462bbdc53ee3a75c805209872a60723398a569172488e83c0f0ef9e1f75a
|
|
BLAKE2b-256 checksum How to use checksums |
69bf54682d8467cd3e7b073d8b2b1f19d190ec78f4b2aa493e6f3a3674190f58
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.11
|
Security for llamator 3.5.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.