Skip to main content

Quantification Library

Project description

MLQuantify

A Python Package for Quantification


mlquantify is a Python library for quantification, also known as supervised prevalence estimation, designed to estimate the distribution of classes within datasets. It offers a range of tools for various quantification methods, model selection tailored for quantification tasks, evaluation metrics, and protocols to assess quantification performance. Additionally, mlquantify includes popular datasets and visualization tools to help analyze and interpret results.


Latest Release

  • Version 0.0.1: Inicial beta version. For a detailed list of changes, check the changelog.
  • In case you need any help, refer to the wiki.
  • Explore the API documentation for detailed developer information.
  • See also the library in the pypi site in pypi mlquantify

Installation

To install mlquantify, run the following command:

pip install mlquantify

Contents

Section Description
Quantification Methods Methods for quantification, such as classify & Count Correct methods, Threshold Optimization, Mixture Models and more.
Dynamic class management All methods are dynamic, and handles multiclass and binary problems, in case of binary it makes One-Vs-All (OVA) automatically.
Model Selection Criteria and processes used to select the best model, such as grid-search for the case of quantification
Evaluation Metrics Specific metrics used to evaluate quantification performance, (e.g., AE, BIAS, NAE, SE, KLD, etc.).
Evaluation Protocols Evaluation protocols used, based on sampling generation (e.g., APP, NPP, etc.)..
Plotting Results Tools and techniques used to visualize results, such as the protocol results.
Comprehensive Documentation Complete documentation of the project, including code, data, and results.

Quick example:

This code first loads the breast cancer dataset from sklearn, which is then split into training and testing sets. It uses the Expectation Maximisation Quantifier (EMQ) with a RandomForest classifier to predict class prevalence. After training the model, it evaluates performance by calculating and printing the absolute error and bias between the real and predicted prevalences.

import mlquantify as mq
from sklearn.ensemble import RandomForestClassifier
from sklearn.datasets import load_breast_cancer
from sklearn.model_selection import train_test_split

# Loading dataset from sklearn
features, target = load_breast_cancer(return_X_y=True)

#Splitting into train and test
X_train, X_test, y_train, y_test = train_test_split(features, target, test_size=0.3)

#Create the model, here it is the Expectation Maximisation Quantifier (EMQ) with a classifier
model = mq.methods.EMQ(RandomForestClassifier())
model.fit(X_train, y_train)

#Predict the class prevalence for X_test
pred_prevalence = model.predict(X_test)
real_prevalence = mq.utils.get_real_prev(y_test)

#Get the error for the prediction
ae = mq.evaluation.absolute_error(real_prevalence, pred_prevalence)
bias = mq.evaluation.bias(real_prevalence, pred_prevalence)

print(f"Mean Squared Error (MSE) -> {ae:.4f}")
print(f"Bias -> {bias}")

Requirements

  • Scikit-learn
  • pandas
  • numpy
  • joblib
  • tqdm
  • matplotlib
  • xlrd

Documentation

API is avaliable here

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mlquantify-0.0.11.2.tar.gz (34.9 kB view details)

Uploaded Source

Built Distribution

mlquantify-0.0.11.2-py3-none-any.whl (56.5 kB view details)

Uploaded Python 3

File details

Details for the file mlquantify-0.0.11.2.tar.gz.

File metadata

  • Download URL: mlquantify-0.0.11.2.tar.gz
  • Upload date:
  • Size: 34.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.11.7

File hashes

Hashes for mlquantify-0.0.11.2.tar.gz
Algorithm Hash digest
SHA256 222d43253a72b62944cc9cb85da996eb7cda72dfe2448135ed5f88a80e6c5e9a
MD5 fbf02265946996a9cae9ff0af0cb4f96
BLAKE2b-256 885301b6771eab3bf1f6fd0b18c0afd950f7f6b97525bb920e5c79c664f2db22

See more details on using hashes here.

File details

Details for the file mlquantify-0.0.11.2-py3-none-any.whl.

File metadata

File hashes

Hashes for mlquantify-0.0.11.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5ba63a0d5354d0945fbfadd6cffa45286aff933dce8a7f2e37115c924b776c84
MD5 e0798d65385f6446e9b3767ab796e9ed
BLAKE2b-256 fd20c009849be6619f9336550d400f9741fdaefcb54dd303c8f962579926eff7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page