Skip to main content

Fast AI evaluator for scikit-learn models

Project description

Performance under noise

Visualizations are optional and do not affect the decision logic.


⚙️ Main API

AICritic(model, X, y)

  • model: scikit-learn compatible estimator
  • X: feature matrix
  • y: target vector

evaluate(view="all", plot=False)

  • view: "executive", "technical", "details", "all" or custom list
  • plot: generates graphs when True

🧠 What ai-critic Detects

| Category | Risks |

| ------------ | ---------------------------------------- |

| 🔍 Data | Target Leakage, NaNs, Imbalance |

| 🧱 Structure | Excessive Complexity, Overfitting |

| 📈 Validation | Perfect or Statistically Suspicious CV |

| 🧪 Robustness | Stable, Fragile, or Misleading |


🛡️ Best Practices

  • CI/CD: Use executive output as a quality gate
  • Iteration: Use technical output during tuning
  • Governance: Log detailed output
  • Skepticism: Never blindly trust a perfect CV

🧭 Use Cases

  • Pre-deployment Audit
  • ML Governance
  • CI/CD Pipelines
  • Risk Communication for Non-Technical Users

📄 License

Distributed under the MIT License.


🧠 Final Note

ai-critic is not a benchmarking tool. It's a decision-making tool.

If a model fails here, it doesn't mean it's bad—it means it shouldn't be trusted yet.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_critic-0.2.3.tar.gz (8.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_critic-0.2.3-py3-none-any.whl (9.1 kB view details)

Uploaded Python 3

File details

Details for the file ai_critic-0.2.3.tar.gz.

File metadata

  • Download URL: ai_critic-0.2.3.tar.gz
  • Upload date:
  • Size: 8.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for ai_critic-0.2.3.tar.gz
Algorithm Hash digest
SHA256 398ca0eb7d733cacfed32269c4c943a1ec41bcc5035f1e6d3941e695a8aeba9b
MD5 81a8f8c7f713916da09a28cfe13e99ae
BLAKE2b-256 6663c6fe18538306ed2448684dabcb9d0a9b1df0870ffc59fb4525cc5b6d3178

See more details on using hashes here.

File details

Details for the file ai_critic-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: ai_critic-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 9.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for ai_critic-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b3bdf05e7922d951f786f897f69805b5905c8045b18fb8fab1ba5f356f799c4d
MD5 cf5ccc2ded66d52877dd9810adbfc764
BLAKE2b-256 9dd07ade002c25030acc10089502b4a10ac3fea96d48980560ce510510dc3e1d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page