Skip to main content

Automated dataset health analysis and preprocessing recommendations.

Project description

๐Ÿฉบ MLDoctor

AI-Powered Dataset Diagnostic System built with Streamlit

MLDoctor is an intelligent web application that analyzes CSV datasets and provides detailed insights into data quality, preprocessing requirements, visualization, machine learning recommendations, and automated PDF reporting.


๐Ÿ“ธ Project Preview

home

โœจ Features

๐Ÿ“Š Dataset Health Analysis

dh2
  • Total rows and columns
  • Dataset health score
  • Missing value detection
  • Duplicate detection
  • Numeric & categorical feature count
  • Memory usage analysis

๐Ÿฉน Missing Value Analysis

mv3
  • Missing value count
  • Missing percentage
  • AI preprocessing suggestions
  • Interactive visualizations

๐Ÿ“ˆ Outlier Detection

out4
  • IQR-based outlier detection
  • Outlier percentage
  • Boxplot visualization
  • AI recommendations

๐Ÿ”— Correlation Analysis

cor4
  • Correlation heatmap
  • Highly correlated feature detection
  • Correlation matrix
  • Feature relationship analysis

๐Ÿค– AI Model Recommendation

aimod6

Automatically detects whether the problem is:

  • Classification
  • Regression

Then recommends suitable machine learning algorithms.

Examples:

Classification

  • Logistic Regression
  • Random Forest
  • XGBoost
  • Support Vector Machine
  • Naive Bayes

Regression

  • Linear Regression
  • Random Forest Regressor
  • XGBoost Regressor
  • Decision Tree
  • Support Vector Regression (SVR)

๐Ÿš€ AutoML

autoMl7

Automatically prepares datasets for machine learning.

Includes:

  • Missing value handling
  • Duplicate removal
  • Feature encoding
  • Feature scaling
  • Train/Test Split

๐Ÿ“Š Interactive Visualizations

vis9

Supports multiple chart types:

  • Histogram
  • Scatter Plot
  • Line Chart
  • Box Plot
  • Correlation Heatmap
  • Pie Chart
  • Bar Chart

Users can interactively choose dataset columns.


๐Ÿ“„ Professional PDF Report

exp8

Generate a complete analysis report containing:

  • Cover Page
  • Dataset Summary
  • Column Information
  • Numeric Statistics
  • Missing Value Analysis
  • Outlier Analysis
  • Correlation Analysis
  • AI Recommendations
  • Dataset Visualizations

๐Ÿ–ฅ๏ธ Tech Stack

Frontend

  • Streamlit

Backend

  • Python

Libraries

  • Pandas
  • NumPy
  • Plotly
  • Matplotlib
  • Seaborn
  • Scikit-Learn
  • ReportLab

๐Ÿ“‚ Project Structure

MLDoctor/
โ”‚
โ”œโ”€โ”€ dashboard/
โ”‚   โ”œโ”€โ”€ assets/
โ”‚   โ”‚    โ”œโ”€โ”€ logo.png
โ”‚   โ”‚    โ””โ”€โ”€ style.css
โ”‚   โ”‚
โ”‚   โ”œโ”€โ”€ pages/
โ”‚   โ”‚    โ”œโ”€โ”€ 1_Dataset_Health.py
โ”‚   โ”‚    โ”œโ”€โ”€ 2_Missing_Values.py
โ”‚   โ”‚    โ”œโ”€โ”€ 3_Outliers.py
โ”‚   โ”‚    โ”œโ”€โ”€ 4_Correlation.py
โ”‚   โ”‚    โ”œโ”€โ”€ 5_Recommendations.py
โ”‚   โ”‚    โ”œโ”€โ”€ 6_Model_Recommendation.py
โ”‚   โ”‚    โ”œโ”€โ”€ 7_AutoML.py
โ”‚   โ”‚    โ”œโ”€โ”€ 8_Export_Report.py
โ”‚   โ”‚    โ””โ”€โ”€ Visualizations.py
โ”‚   โ”‚
โ”‚   โ””โ”€โ”€ Home.py
โ”‚
โ”œโ”€โ”€ report_assets/
โ”œโ”€โ”€ reports/
โ”œโ”€โ”€ README.md
โ””โ”€โ”€ requirements.txt

โš™๏ธ Installation

Clone the repository

git clone https://github.com/yourusername/MLDoctor.git

Go inside the project

cd MLDoctor

Install dependencies

pip install -r requirements.txt

Run the application

streamlit run dashboard/Home.py

๐Ÿ“ฆ Required Packages

streamlit
pandas
numpy
plotly
matplotlib
seaborn
scikit-learn
reportlab
openpyxl

๐ŸŽฏ Workflow

Upload Dataset
        โ”‚
        โ–ผ
Dataset Health Analysis
        โ”‚
        โ–ผ
Missing Value Analysis
        โ”‚
        โ–ผ
Outlier Detection
        โ”‚
        โ–ผ
Correlation Analysis
        โ”‚
        โ–ผ
Model Recommendation
        โ”‚
        โ–ผ
AutoML
        โ”‚
        โ–ผ
Interactive Visualizations
        โ”‚
        โ–ผ
Generate Professional PDF Report

๐Ÿ“Š Supported Dataset Format

  • CSV (.csv)

Example datasets:

  • Healthcare
  • Finance
  • Sales
  • Marketing
  • Student Performance
  • Vehicle Dataset
  • Weather Dataset

๐Ÿš€ Future Improvements

  • SQL Database Support
  • Excel Dataset Support
  • AI Chat Assistant
  • Feature Importance Analysis
  • SHAP Explainability
  • Hyperparameter Optimization
  • Deep Learning Models
  • Cloud Deployment

๐Ÿ‘จโ€๐Ÿ’ป Author

Kevin Joel

Artificial Intelligence & Machine Learning Student


๐ŸŒ Live Demo

https://mldoctor-ju260m9c9pcyzfg6edmezr.streamlit.app

๐Ÿ“œ License

This project is intended for educational and academic purposes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mldoctor-1.0.0.tar.gz (14.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mldoctor-1.0.0-py3-none-any.whl (15.5 kB view details)

Uploaded Python 3

File details

Details for the file mldoctor-1.0.0.tar.gz.

File metadata

  • Download URL: mldoctor-1.0.0.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.6

File hashes

Hashes for mldoctor-1.0.0.tar.gz
Algorithm Hash digest
SHA256 91d16a698933e871d996c2cbc4dadd184b3b66f9889bb9818f3510ded4377ec0
MD5 f7c3a16645c281f87b9fe6ed535e22db
BLAKE2b-256 c9e21c59f74bdc3e3989751fafb219a72f0d19fbe962078a9f371c464eb97cbe

See more details on using hashes here.

File details

Details for the file mldoctor-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: mldoctor-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 15.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.6

File hashes

Hashes for mldoctor-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3166a04d6f0505d1bd5a2a705230561643699639e982bda2fe6ce79c933a14b7
MD5 1305d68cc883384b3c3307b49628b99c
BLAKE2b-256 d07d9229c9e0996e7cbfa7405bc707e27650dcc863c6d484cf02e3a537dba37a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page