Skip to main content

VerifIA is an open-source AI testing framework for domain‑aware verification of AI models during the staging phase—before deployment.

Project description

VerifIA logo

Domain‑Aware Verification Framework for AI Models

GitHub release License Docs

DocsWebsite



VerifIA is an open‑source Python library that automates domain‑aware verification of machine‑learning models during the staging phase—before deployment. It generates novel, in‑domain inputs and checks your model against expert‑defined rules, constraints, and specifications, helping you:

  • Validate behavioral consistency with domain knowledge
  • 🔍 Detect edge‑case failures beyond your labeled data
  • 📊 Generate comprehensive HTML reports for decision‑making and debugging

📖 Try in Colab

Open in Colab


📸 Result Preview [TBD]

[TBD: ADD TEXT HERE]

Verification report preview


🚀 Install

# Core framework
pip install verifia

# Include AI‑Based Domain Generation
pip install verifia[domain]

Supports Python 3.10+.


🤸‍♀️ Quickstart

from verifia.verification import RuleConsistencyVerifier

# 1. Load your domain spec
verifier = RuleConsistencyVerifier("domain_rules.yaml")

# 2. Attach model and data
report = (
    verifier
      .verify(model_card_fpath_or_dict="model_card.yaml")
      .on(data_fpath="test_data.csv")        # .csv, .json, .xlsx, .parquet, .feather, .pkl
      .using("GA")                           # RS, FFA, MFO, GWO, MVO, PSO, WOA, GA, SSA
      .run(pop_size=50, max_iters=100)       # search budget
)

# 3. Save your report
report.save_as_html("verification_report.html")

Quickstart Steps

👉 Full Quickstart guide: https://docs.verifia.ai/quickstart


📚 Feature Spotlight: AI‑Based Domain Generation

Automatically build your domain specification from CSVs, DataFrames, and PDFs using LLM‑powered agents. No manual rule‑writing required—point VerifIA at your data and let it generate variables, constraints, and rules for you.

📖 Learn More


🧰 Ecosystem & Integrations

VerifIA works with any model, in any environment and integrates seamlessly with your favorite tools ⤵️

scikit-learn LightGBM
CatBoost XGBoost PyTorch TensorFlow

MLflow Comet ML Weights & Biases OpenAI


📖 Learn More


🤝 Contributing

We welcome all contributions! Please read our CONTRIBUTING.md to get started.


⚖️ License

VerifIA is released under the AGPL‑3.0 License. See LICENSE for details.


Made with ❤️ by the VerifIA contributors.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

verifia-0.1.0.tar.gz (119.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

verifia-0.1.0-py3-none-any.whl (124.9 kB view details)

Uploaded Python 3

File details

Details for the file verifia-0.1.0.tar.gz.

File metadata

  • Download URL: verifia-0.1.0.tar.gz
  • Upload date:
  • Size: 119.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for verifia-0.1.0.tar.gz
Algorithm Hash digest
SHA256 63c6fb951c4f695e8c5a4545a2e027ab9ee83d578922c1e24a532b34778df44b
MD5 e35ef37aaf19a7a8a9d9f8c7c86c74ae
BLAKE2b-256 7eea76089110414137fe040a441372c9cd2e5cea2169d9935d0ec71f23da778c

See more details on using hashes here.

File details

Details for the file verifia-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: verifia-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 124.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for verifia-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a6e1c5a0246b3ba34b5011b2a0930b9550f4f0022156663f22d01e063b7906fa
MD5 39731d68bb23c8cc633dda93f59a208e
BLAKE2b-256 c8a7f731b5bc672225903e9c8981381456fb6bb5733fa89b63479a074252d922

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page