Fast AI evaluator for scikit-learn models
Project description
Performance under noise
Visualizations are optional and do not affect the decision logic.
⚙️ Main API
AICritic(model, X, y)
model: scikit-learn compatible estimatorX: feature matrixy: target vector
evaluate(view="all", plot=False)
view:"executive","technical","details","all"or custom listplot: generates graphs whenTrue
🧠 What ai-critic Detects
| Category | Risks |
| ------------ | ---------------------------------------- |
| 🔍 Data | Target Leakage, NaNs, Imbalance |
| 🧱 Structure | Excessive Complexity, Overfitting |
| 📈 Validation | Perfect or Statistically Suspicious CV |
| 🧪 Robustness | Stable, Fragile, or Misleading |
🛡️ Best Practices
- CI/CD: Use executive output as a quality gate
- Iteration: Use technical output during tuning
- Governance: Log detailed output
- Skepticism: Never blindly trust a perfect CV
🧭 Use Cases
- Pre-deployment Audit
- ML Governance
- CI/CD Pipelines
- Risk Communication for Non-Technical Users
📄 License
Distributed under the MIT License.
🧠 Final Note
ai-critic is not a benchmarking tool. It's a decision-making tool.
If a model fails here, it doesn't mean it's bad—it means it shouldn't be trusted yet.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ai_critic-0.2.3.tar.gz.
File metadata
- Download URL: ai_critic-0.2.3.tar.gz
- Upload date:
- Size: 8.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
398ca0eb7d733cacfed32269c4c943a1ec41bcc5035f1e6d3941e695a8aeba9b
|
|
| MD5 |
81a8f8c7f713916da09a28cfe13e99ae
|
|
| BLAKE2b-256 |
6663c6fe18538306ed2448684dabcb9d0a9b1df0870ffc59fb4525cc5b6d3178
|
File details
Details for the file ai_critic-0.2.3-py3-none-any.whl.
File metadata
- Download URL: ai_critic-0.2.3-py3-none-any.whl
- Upload date:
- Size: 9.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b3bdf05e7922d951f786f897f69805b5905c8045b18fb8fab1ba5f356f799c4d
|
|
| MD5 |
cf5ccc2ded66d52877dd9810adbfc764
|
|
| BLAKE2b-256 |
9dd07ade002c25030acc10089502b4a10ac3fea96d48980560ce510510dc3e1d
|