Skip to main content

ML package for data cubes

Project description

ml4xcube: Machine Learning Toolkits for Data Cubes

Welcome to ml4xcube, a comprehensive Python-based toolkit designed for researchers and developers in the field of machine learning with an emphasis on xarray data cubes. Our toolkit is engineered to provide specialized and robust support for data cube management and analysis, operating with the state-of-the-art machine learning libraries (1) scikit-learn, (2) PyTorch and (3) TensorFlow.

Installation

Get started with ml4xcube effortlessly by installing it directly through pip:

pip install ml4xcube

or Conda:

conda install -c conda-forge ml4xcube

Make sure you have Python version 3.8 or higher.

If you're planning to use ml4xcube with TensorFlow or PyTorch, set up these frameworks properly in your Conda environment.

Features

  • Data preprocessing and normalization/standardization functions
  • Gap filling features
  • Dataset creation and train-/ test split sampling techniques
  • Trainer classes for sklearn, TensorFlow and PyTorch
  • Distributed training framework compatible with PyTorch
  • chunk utilities for working with data cubes

Usage

To use ml4xcube in your project, simply import the necessary module:

from ml4xcube.statistics import normalize, standardize
from ml4xcube.training.pytorch import Trainer
# Other imports...

You can then call the functions directly:

# Normalizing data
normalized_data = normalize(your_data, data_min, data_max)

# Trainer instance
trainer = Trainer(
    model           = reg_model,
    train_data      = train_loader,
    test_data       = test_loader,
    optimizer       = optimizer,
    best_model_path = best_model_path,
    early_stopping  = True,
    patience        = 3,
    epochs          = epochs
)

# Start training
reg_model = trainer.train()

License

ml4xcube is released under the MIT License. See the LICENSE file for more details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ml4xcube-0.0.6.tar.gz (781.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ml4xcube-0.0.6-py3-none-any.whl (804.3 kB view details)

Uploaded Python 3

File details

Details for the file ml4xcube-0.0.6.tar.gz.

File metadata

  • Download URL: ml4xcube-0.0.6.tar.gz
  • Upload date:
  • Size: 781.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-0.0.6.tar.gz
Algorithm Hash digest
SHA256 3f58ed6e4babf54cf935bc881348ceea99c8207c24e878d2e793bb8bb9221903
MD5 165bcc2083ee493c759651a673ae84cc
BLAKE2b-256 4a6d4fe318e238837e9d2b6f2c789ad612fff2f8e7d629ef7425dfa5d2c87c21

See more details on using hashes here.

File details

Details for the file ml4xcube-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: ml4xcube-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 804.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.10.5

File hashes

Hashes for ml4xcube-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 bef26c18439905308f9acd36b701200e9cbd069eef56accc55bf12324c7e6db4
MD5 e33c2fe8c9504899e7b3ed6fa3cce6f6
BLAKE2b-256 74c0c0336af5b16c2035543f80b46c53d4e4028ad946e066c68151ea985369aa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page