Skip to main content

Complete pipelines and helper tools for data science and machine learning projects.

Project description

dragon-ml-toolbox

A collection of machine learning pipelines and utilities, structured as modular packages for easy reuse and installation. This package has no base dependencies, allowing for lightweight and customized virtual environments.

Features:

  • Modular scripts for data exploration, logging, machine learning, and more.
  • Designed for seamless integration as a Git submodule or installable Python package.

Installation

Python 3.12

Via PyPI

Install the latest stable release from PyPI:

pip install dragon-ml-toolbox

Via conda-forge

Install from the conda-forge channel:

conda install -c conda-forge dragon-ml-toolbox

Via GitHub (Editable)

Clone the repository and install in editable mode:

git clone https://github.com/DrAg0n-BoRn/ML_tools.git
cd ML_tools
pip install -e .

Modular Installation

This toolbox is designed as a collection of mutually exclusive environments due to conflicting core dependencies, except APP bundlers (PyInstaller/Nuitka).

  • Rule: Create a fresh virtual environment for each module to use.

📦 Core Machine Learning Toolbox [ML]

Installs a comprehensive set of tools for typical data science workflows, including data manipulation, modeling, and evaluation using PyTorch.

➡️ Prerequisite: PyTorch required. Follow the official instructions: PyTorch website

pip install "dragon-ml-toolbox[ML]"

Modules:

constants
custom_logger
data_exploration
ETL_cleaning
ETL_engineering
math_utilities
ML_callbacks
ML_configuration
ML_datasetmaster
ML_evaluation_captum
ML_evaluation_multi
ML_evaluation
ML_inference
ML_models
ML_models_advanced
ML_optimization_pareto
ML_optimization
ML_scaler
ML_sequence_datasetmaster
ML_sequence_evaluation
ML_sequence_inference
ML_sequence_models
ML_trainer
ML_utilities
ML_vision_datasetmaster
ML_vision_evaluation
ML_vision_inference
ML_vision_models
ML_vision_transformers
optimization_tools
path_manager
serde
SQL
utilities

Wrappers for some pytorch_tabular models are available:

pip install "dragon-ml-toolbox[ML,py-tab]"

# Extra Modules:
ML_models_pytab
ML_configuration_pytab

🌳 Ensemble Learning [ensemble]

Comprehensive set of tools for typical data science workflows focused on XGBoost and LightGBM.

Note: Optimizes for NumPy >= 2.0.

pip install "dragon-ml-toolbox[ensemble]"

Modules:

constants
custom_logger
data_exploration
ensemble_evaluation
ensemble_inference
ensemble_learning
ETL_cleaning
ETL_engineering
math_utilities
optimization_tools
path_manager
PSO_optimization
serde
SQL
utilities

🔬 MICE Imputation and Variance Inflation Factor [mice]

Utilities for advanced data cleaning and statistical checks. Features Multiple Imputation by Chained Equations (MICE) for handling missing data and Variance Inflation Factor (VIF) analysis to detect multicollinearity in features.

pip install "dragon-ml-toolbox[mice]"

Modules:

constants
custom_logger
math_utilities
MICE_imputation
serde
VIF_factor
path_manager
utilities

📋 Excel File Handling [excel]

Installs dependencies required to process and handle .xlsx or .xls files.

pip install "dragon-ml-toolbox[excel]"

Modules:

custom_logger
handle_excel
path_manager

🎰 GUI for Boosting Algorithms (XGBoost, LightGBM) [gui-boost]

GUI tools compatible with XGBoost and LightGBM models used for inference.

pip install "dragon-ml-toolbox[gui-boost]"

Modules:

constants
custom_logger
GUI_tools
ensemble_inference
path_manager
serde

🤖 GUI for PyTorch Models [gui-torch]

GUI tools compatible with PyTorch models used for inference.

pip install "dragon-ml-toolbox[gui-torch]"

Modules:

constants
custom_logger
GUI_tools
ML_models
ML_sequence_models
ML_vision_models
ML_inference
ML_sequence_inference
ML_vision_inference
ML_vision_transformers
ML_scaler
path_manager

⚒️ APP bundlers

Dependencies required to compile applications, inference scripts, or GUIs into standalone executables (.exe or binary) for distribution. Choose your preferred backend:

pip install "dragon-ml-toolbox[pyinstaller]"
pip install "dragon-ml-toolbox[nuitka]"

Usage

After installation, import modules like this:

from ml_tools.serde import serialize_object, deserialize_object
from ml_tools import custom_logger

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dragon_ml_toolbox-18.0.0.tar.gz (254.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

dragon_ml_toolbox-18.0.0-py3-none-any.whl (294.0 kB view details)

Uploaded Python 3

File details

Details for the file dragon_ml_toolbox-18.0.0.tar.gz.

File metadata

  • Download URL: dragon_ml_toolbox-18.0.0.tar.gz
  • Upload date:
  • Size: 254.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for dragon_ml_toolbox-18.0.0.tar.gz
Algorithm Hash digest
SHA256 23856bd37764be7c935d534d862fe4d54027188d4cf61c852b655afa20fa0634
MD5 174d3b25e3587dd63ddf27771f3c918b
BLAKE2b-256 c8b36572cee56743d5c512f814d8f472fd450d84289032badb7cd41281e98cab

See more details on using hashes here.

File details

Details for the file dragon_ml_toolbox-18.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for dragon_ml_toolbox-18.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 098a7c5139c437a14a05bf1d00c38df62af329351801db978b107f299bf8bd5f
MD5 44da9f8a30c22157800ca760bf4a626d
BLAKE2b-256 e70ec067b0a15225be8198d1ebce8ff4e05d595986e5f371b74aefb85293307b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page