verifia 0.1.0rc0

VerifIA is an open-source AI testing framework for domain‑aware verification of AI models during the staging phase—before deployment.

Domain‑Aware Verification Framework for AI Models

Docs • Website

---

VerifIA is an open‑source Python library that automates domain‑aware verification of machine‑learning models during the staging phase—before deployment. It generates novel, in‑domain inputs and checks your model against expert‑defined rules, constraints, and specifications, helping you:

• ✅ Validate behavioral consistency with domain knowledge
• 🔍 Detect edge‑case failures beyond your labeled data
• 📊 Generate comprehensive HTML reports for decision‑making and debugging

---

📖 Try in Colab

---

🚀 Install

# Core framework
pip install verifia

# Include AI‑Based Domain Generation
pip install verifia[domain]

Supports Python 3.10+.

---

🤸‍♀️ Quickstart

from verifia.verification import RuleConsistencyVerifier

# 1. Load your domain spec
verifier = RuleConsistencyVerifier("domain_rules.yaml")

# 2. Attach model and data
report = (
    verifier
      .verify(model_card_fpath_or_dict="model_card.yaml")
      .on(data_fpath="test_data.csv")        # .csv, .json, .xlsx, .parquet, .feather, .pkl
      .using("GA")                           # RS, FFA, MFO, GWO, MVO, PSO, WOA, GA, SSA
      .run(pop_size=50, max_iters=100)       # search budget
)

# 3. Save your report
report.save_as_html("verification_report.html")

Quickstart Steps

• Install: install
• Prepare Your Components (Domain, Model, Data): prepare-your-components
• Run Verification: run-a-verification
• Inspect Results: inspecting-results

👉 Full Quickstart guide: https://docs.verifia.ca/quickstart

---

📚 Feature Spotlight: AI‑Based Domain Generation

Automatically build your domain specification from CSVs, DataFrames, and PDFs using LLM‑powered agents. No manual rule‑writing required—point VerifIA at your data and let it generate variables, constraints, and rules for you.

🎬 Demo: AI‑Based Domain Generation UI

▶️

Fig. Interactive animated demo—click to open full resolution.

📖 Learn More

• Prerequisites & Setup: #environment-setup
• Prepare Domain Spec: #prepare-your-domain
• Run Generation: #run-domain-generation

---

🧰 Ecosystem & Integrations

VerifIA works with any model, in any environment and integrates seamlessly with your favorite tools ⤵️

---

📖 More Resources

• Documentation: https://docs.verifia.ca
• Website: https://verifia.ca
• Source Code: https://github.com/VerifIA/verifia
• Contact: [e-mail]

---

🤝 Contributing

We welcome all contributions! Please read our CONTRIBUTING.md to get started.

---

⚖️ License

VerifIA is released under the AGPL‑3.0 License. See LICENSE for details.

---

Made with ❤️ by the VerifIA contributors.