Skip to main content

Fast AI evaluator for scikit-learn models

Project description

Performance under noise

Visualizations are optional and do not affect the decision logic.


⚙️ Main API

AICritic(model, X, y)

  • model: scikit-learn compatible estimator
  • X: feature matrix
  • y: target vector

evaluate(view="all", plot=False)

  • view: "executive", "technical", "details", "all" or custom list
  • plot: generates graphs when True

🧠 What ai-critic Detects

| Category | Risks |

| ------------ | ---------------------------------------- |

| 🔍 Data | Target Leakage, NaNs, Imbalance |

| 🧱 Structure | Excessive Complexity, Overfitting |

| 📈 Validation | Perfect or Statistically Suspicious CV |

| 🧪 Robustness | Stable, Fragile, or Misleading |


🛡️ Best Practices

  • CI/CD: Use executive output as a quality gate
  • Iteration: Use technical output during tuning
  • Governance: Log detailed output
  • Skepticism: Never blindly trust a perfect CV

🧭 Use Cases

  • Pre-deployment Audit
  • ML Governance
  • CI/CD Pipelines
  • Risk Communication for Non-Technical Users

📄 License

Distributed under the MIT License.


🧠 Final Note

ai-critic is not a benchmarking tool. It's a decision-making tool.

If a model fails here, it doesn't mean it's bad—it means it shouldn't be trusted yet.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ai_critic-0.2.4.tar.gz (8.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ai_critic-0.2.4-py3-none-any.whl (9.1 kB view details)

Uploaded Python 3

File details

Details for the file ai_critic-0.2.4.tar.gz.

File metadata

  • Download URL: ai_critic-0.2.4.tar.gz
  • Upload date:
  • Size: 8.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for ai_critic-0.2.4.tar.gz
Algorithm Hash digest
SHA256 2e717df9740ced7be4fb302549e9aa17b6e4d968b0c270818d389affe179ee18
MD5 7c96831eb20dc34b0c8b812cadab557d
BLAKE2b-256 ba864d0e533f327cb299f205db75d6d332be0dc1749eb717eef179a1b1c7a0f5

See more details on using hashes here.

File details

Details for the file ai_critic-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: ai_critic-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 9.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for ai_critic-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 976a83f788f806b994238ff355e6ccc3b95fa31aa85dc666962775813786ec8d
MD5 cbfd00e4104d02b3f1b43b2a54c6a8c7
BLAKE2b-256 94d6d46d775855e0398dbd9eb24dfed1d8b5dbe9c368b9553d16e5d5210b73b9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page