Framework for testing vulnerabilities of large language models (LLM).
Project description
LLAMATOR
Description 📖
Red teaming python-framework for testing vulnerabilities of chatbots based on large language models (LLM). Supports testing of Russian-language RAG systems.
Install 🚀
pip install llamator==1.1.0
Documentation 📚
Documentation Link: https://romiconez.github.io/llamator
Examples 💡
- 📄 RAG Chatbot testing via API (RU)
- 🧙♂️ Gandalf bot testing via Selenium (RU)
- 💬 Telegram bot testing via Telethon (RU)
- 📱 WhatsApp client testing via Selenium (ENG)
- 🔗 LangChain client testing with custom attack (RU)
Supported Clients 🛠️
- 🌐 All LangChain clients
- 🧠 OpenAI-like API
- ⚙️ Custom Class (Telegram, Selenium, etc.)
Unique Features 🌟
- 🛡️ Support for custom attacks from the user
- 📊 Results of launching each attack in CSV format
- 📈 Report with attack requests and responses for all tests in Excel format
- 📄 Test report document available in DOCX format
License 📜
© Roman Neronov, Timur Nizamov, Nikita Ivanov
This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llamator-1.1.0.tar.gz.
File metadata
- Download URL: llamator-1.1.0.tar.gz
- Upload date:
- Size: 103.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
09b1f69de5d8eef048107d0be26384c5dfeb79298d89680b096b15605135af5c
|
|
| MD5 |
a7a14323d2549c5f084ba620776129d7
|
|
| BLAKE2b-256 |
d98d78e796c25dda411dd6bacc9850a80f4d48b2e6621f73db8385922f217044
|
File details
Details for the file llamator-1.1.0-py2.py3-none-any.whl.
File metadata
- Download URL: llamator-1.1.0-py2.py3-none-any.whl
- Upload date:
- Size: 128.0 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e1442156f03c16c9af4461573a41a8169f5ca76895a9640fc9308ed4c48f2f17
|
|
| MD5 |
d67a57f42c5ecffe30e4b134d5250ad4
|
|
| BLAKE2b-256 |
779075f239104a67a6643a1ba474470727b8c86b5d5ef005a8ebea932150cb2c
|
