Red Teaming python-framework for testing chatbots and GenAI systems
Install 🚀
pip install llamator==3.5.0
Documentation 📚
Documentation Link: https://LLAMATOR-Core.github.io/llamator
Guides ▶️
Examples 💡
- 📄 RAG bot testing via REST API
- 🧙♂️ Gandalf web bot testing via Selenium
- 💬 Telegram bot testing via Telethon
- 📱 WhatsApp bot testing via Selenium
- 🔗 LangChain client testing with custom attack
- 📷 Vision Model testing via LangChain
- 🐋 Running LLAMATOR in Docker
Supported Clients 🛠️
- 🌐 All LangChain clients
- 🧠 OpenAI-like API
- ⚙️ Custom Class (Telegram, WhatsApp, Selenium, etc.)
Unique Features 🌟
- ️🗡 Support for custom attacks and datasets from the user
- 👜 Large selection of attacks on LLMs, RAGs, Agents, VLMs in English and Russian
- 🛡 Custom configuration of chat clients
- 📊 History of attack requests and responses in Excel and CSV format
- 📄 Test report document in DOCX format
OWASP Classification 🔒
- 💉 LLM01: Prompt Injection and Jailbreaks
- 🕵️♀️ LLM07: System Prompt Leakage
- 🤥 LLM09: Misinformation
- 💸 LLM10: Unbounded Consumption
Community 🌍
- 💬 Telegram Chat — LLAMATOR | AI Red Team Community
- 🖤 Supported by AI Talent Hub and ITMO University
Contacts 📬
✉️ Email: team@llamator.org
Enterprise Version 🏢
⚡️Coming Soon⚡️
License 📜
© Roman Neronov, Timur Nizamov, Nikita Ivanov
This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.
1 maintainer
Release files for llamator 3.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llamator-3.5.0.tar.gz | 1.5 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llamator-3.5.0-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 3.0 MB
Release files / llamator-3.5.0.tar.gz
| Download URL | llamator-3.5.0.tar.gz |
|---|---|
| Size | 1.5 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9a25f0f7daf0a6ef02f2b6fda72c3f357424a348173bd8cf6649ebb28815d602
|
|
BLAKE2b-256 checksum How to use checksums |
d88cbbe3587bc82b01a872c0f59932024da5f2108991c7481fe64c65b1c102c3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.11
|
Release files / llamator-3.5.0-py2.py3-none-any.whl
| Download URL | llamator-3.5.0-py2.py3-none-any.whl |
|---|---|
| Size | 1.5 MB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
77ce462bbdc53ee3a75c805209872a60723398a569172488e83c0f0ef9e1f75a
|
|
BLAKE2b-256 checksum How to use checksums |
69bf54682d8467cd3e7b073d8b2b1f19d190ec78f4b2aa493e6f3a3674190f58
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.11
|
