Skip to main content

A modular framework for registering and running haphazard datasets and models.

Project description

Haphazard

A Python package for haphazard dataset and model management.
Provides a standardized interface for loading datasets and models, running experiments, and extending with custom datasets or models.


Table of Contents


Installation

Install via pip (after packaging):

pip install haphazard

Or for local development:

git clone <repo_url>
cd haphazard
pip install -e .

Project Structure

The Haphazard package has a modular layout:

haphazard/
├── __init__.py                    # Top-level package
├── data/                          # Dataset related modules
│   ├── __init__.py
│   ├── base_dataset.py            # Abstract BaseDataset class
│   ├── mask.py
│   └── datasets/   
│       ├── __init__.py            # All dataset implementations
│       ├── dummu_dataset/
│       ├── magic04/
│       ├── dry_bean/
│       └── gas/
├── models/                        # Model related modules
│   ├── __init__.py
│   ├── base_model.py              # Abstract BaseModel class
│   └── model_zoo/                 # All model implementations
│       ├── __init__.py
│       ├── dummu_model/
│       ├── olvf/
│       ├── olifl/
│       └── ovfm/
└── utils/                         # Optional helper functions
    └── ...

Notes:

  • data/base_dataset.py defines BaseDataset.
  • data/datasets/ contains registered datasets; each dataset is a submodule with __init__.py.
  • models/base_model.py defines BaseModel.
  • models/model_zoo/ contains registered models; each model is a submodule with __init__.py.
  • utils/ is optional, for shared helpers.

This layout allows dynamic registration of datasets and models via decorators.


Quick Start

from haphazard import load_dataset, load_model

# Load dataset
dataset = load_dataset("dummy", n_samples=100, n_features=10)

# Load model
model = load_model("dummy")

# Run model
outputs = model(dataset)
print(outputs)

Datasets

  • All datasets must inherit from BaseDataset.
  • Example dataset: DummyDataset.
  • Main interface:
from haphazard import load_dataset

dataset = load_dataset("dummy", base_path="./data")
x, y = dataset.load_data()
mask = dataset.load_mask(scheme="probabilistic", availability_prob=0.5)

Dataset Attributes

  • name : str — Dataset name.
  • task : "classification" | "regression".
  • haphazard_type : "controlled" | "intrinsic".
  • n_samples, n_features : int.
  • num_classes : int (for classification).

Available Datasets (does not include raw files)

  • Dummy ("dummy"): For testing and prototyping.
  • Magic04 ("magic04"): Binary classification
  • Dry Bean ("dry_bean"): Multi-class classification
  • GAS ("gas"): Multi-class classification

Models

  • All models must inherit from BaseModel.
  • Example model: DummyModel.
  • Main interface:
from haphazard import load_model

model = load_model("dummy")
outputs = model(dataset)

Output

  • Classification: labels, preds, logits, time_taken, is_logit.
  • Regression: targets, preds, time_taken.

Available Models

  • Dummy ("dummy"): For testing and prototyping.
  • OLVF ("olvf"): Supports binary and multi-class classification.
  • OLIFL ("olifl"): Supports binary and multi-class classification.

Versions

v1.0.2

  • Added model OVFM

v1.0.0

(Considered to be the base version, ignore versions before this)

  • Includes models 'OLVF' and 'OLIFL' models natively.
  • Includes datasets 'Magic04', 'Dry Bean' and 'Gas'. (Does not include raw files to read from, please use base_path argument to point to relevant path containing the raw files).

Contributing

Haphazard is designed for easy extensibility. You can add new datasets and models.

Adding a new dataset

  1. Create a new folder under haphazard/data/datasets/, e.g., my_dataset/.
  2. Add __init__.py:
from ...base_dataset import BaseDataset
from ...datasets import register_dataset
import numpy as np

@register_dataset("my_dataset")
class MyDataset(BaseDataset):
    def __init__(self, base_path="./", **kwargs):
        self.name = "my_dataset"
        self.haphazard_type = "controlled"
        self.task = "classification"
        super().__init__(base_path=base_path, **kwargs)

    def read_data(self, base_path="./"):
        # Load or generate x, y
        x = np.random.random((100, 10))
        y = np.random.randint(0, 2, 100)
        return x, y
  1. The dataset is automatically registered and can be loaded with load_dataset("my_dataset").

Adding a new model

  1. Create a new folder under haphazard/models/model_zoo/, e.g., my_model/.
  2. Add __init__.py:
from ...base_model import BaseModel, BaseDataset
from ...model_zoo import register_model
import numpy as np

@register_model("my_model")
class MyModel(BaseModel):
    def __init__(self, **kwargs):
        self.name = "MyModel"
        self.tasks = {"classification", "regression"}
        self.deterministic = True
        self.hyperparameters = set()
        super().__init__(**kwargs)

    def fit(self, dataset: BaseDataset, mask_params=None, model_params=None, seed=42):
        # Dummy implementation
        x, y = dataset.load_data()
        mask = dataset.load_mask(**mask_params)
        preds = np.random.randint(0, 2, size=y.shape[0])
        if dataset.task == "classification":
            return {
                "labels": y,
                "preds": preds,
                "logits": preds.astype(float),
                "time_taken": 0.0,
                "is_logit": True
            }
        elif dataset.task == "regression":
            return {
                "targets": y,
                "preds": preds,
                "time_taken": 0.0,
            }
  1. The model is automatically registered and can be loaded with load_model("my_model").

License

MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

haphazard-1.0.2.tar.gz (50.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

haphazard-1.0.2-py3-none-any.whl (75.5 kB view details)

Uploaded Python 3

File details

Details for the file haphazard-1.0.2.tar.gz.

File metadata

  • Download URL: haphazard-1.0.2.tar.gz
  • Upload date:
  • Size: 50.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for haphazard-1.0.2.tar.gz
Algorithm Hash digest
SHA256 0f2363f3f86ea0d497cb1b28481d053d48d93f8a5fca54cc32592bbdbb6873d0
MD5 301a361a7178a703bc939063d3070dbf
BLAKE2b-256 86784b8491ac22904628ec7be69914319ebed7e097d3fd2c557edb608071435d

See more details on using hashes here.

File details

Details for the file haphazard-1.0.2-py3-none-any.whl.

File metadata

  • Download URL: haphazard-1.0.2-py3-none-any.whl
  • Upload date:
  • Size: 75.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for haphazard-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 cf1450baccc65c4c67fb68703c9011dafb99286b564419f933fb5bcbf1e75550
MD5 75cd33341aa4e29e591720acd222b575
BLAKE2b-256 38b8d98a7b734d10a8e0b3ec47225afe30da9d0826e1ac431f87916983ce8937

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page