This release is a pre-release and may not be stable for production use.
TabPack & TabPackage
This is the official repository and Python package for the paper "TabPack: Efficient Hyperparameter Ensembles for Tabular Deep Learning" (arXiv). TabPack provides:
1. An effective and practical baseline for supervised learning on medium-to-large tabular datasets. It achieves competitive out-of-the-box performance on benchmarks and is efficient enough to get started on a modern MacBook.
2. An efficient way to train and ensemble many MLPs with different hyperparameters for fast experiments. Train hundreds or thousands of MLPs and build many ensembles in one run.
TL;DR
As a predictive tabular model, TabPack is an efficient ensemble of MLPs with different model and optimizer hyperparameters. In a single run, TabPack samples and trains many MLPs with different hyperparameters efficiently in parallel and builds ensembles on the fly during training. See the paper for details.
TabPack is designed to be a good starting point for solving tabular ML tasks on medium-to-large datasets:
- Competitive out-of-the-box performance. The results reported in the paper are achieved with zero hyperparameter tuning.
- Better performance with less compute. On a modern MacBook, training TabPack once and achieving good performance can be faster than tuning other baselines on GPUs.
- Practical for deployment. A trained TabPack is just an ensemble of MLPs that will meet efficiency requirements in many real-world applications.
Overall, TabPack can reduce the time, compute, and tuning effort needed to obtain a good tabular-learning baseline.
TabPackage
TabPackage is the PyTorch-based Python package behind TabPack. It supports efficient parallel training and ensembling of many MLP-like models with different hyperparameters. The main features include:
- High-level training API for TabPack including PyTorch and scikit-learn interfaces.
- PyTorch building blocks, including:
- Module packs for applying layers from many models with different hyperparameters in parallel.
- Optimizer packs for training module packs with different optimization hyperparameters for each member.
- Ensembling utilities for constructing ensembles of models on the fly while they are training.
- Metric functions for computing metrics for each pack member.
Installation
pip install tabpackage
# Or, with the scikit-learn API:
pip install "tabpackage[sklearn]"
Basics
For most users, the examples are the recommended entry point to the package. The following subsections provide high-level sketches of what to expect from the package.
PyTorch training API
Use tabpackage.train to train TabPack on a supervised tabular-learning task with PyTorch:
# Prepare datasets.
raw_datasets: dict[str, dict[str, torch.Tensor]] = {
'train': {'x_num': ..., 'x_cat': ..., 'y': ...},
# At least one additional split is required.
# See the examples for details.
'val': ...,
...
}
datasets = preprocess(raw_datasets)
# Train TabPack.
tabpack = tabpackage.train(datasets=datasets, ...)
# Optionally, retrain TabPack on the combined training and validation data
# for better performance.
if retrain:
raw_datasets['train'] = {
'x_num': torch.cat([
raw_datasets['train']['x_num'],
raw_datasets['val']['x_num'],
]),
...
}
datasets = preprocess(raw_datasets) # Redo the preprocessing.
tabpack = tabpackage.retrain(tabpack, ...)
# Create a predictor, which is a vanilla PyTorch module.
predictor = tabpack.make_predictor(...)
# Make predictions.
y_pred, y_pred_ensembles = predictor(x_num, x_cat)
# Export the model.
...
torch.save(predictor, ...)
torch.onnx.export(predictor, ...)
torch.export.save(torch.export.export(predictor, ...), ...)
scikit-learn API
Use tabpackage.sklearn to train TabPack with a scikit-learn interface:
from tabpackage.sklearn import TabPackClassifier, TabPackRegressor
# Prepare datasets.
X_train, y_train = ...
X_val, y_val = ...
X_test = ...
# Train TabPack.
tabpack = TabPackClassifier(...) # Or TabPackRegressor(...).
# The extra dataset split is required. See the examples for details.
tabpack.fit(X_train, y_train, extra_set=(X_val, y_val))
# Optionally, retrain TabPack on the combined training and validation data
# for better performance.
if retrain:
X_full, y_full = ... # Merge train + val and redo data preprocessing.
tabpack.refit(X_full, y_full)
# Make predictions.
y_pred = tabpack.predict(X_test)
y_proba = tabpack.predict_proba(X_test) # Classification only.
API Overview
The package is designed to be easy to learn from well-documented examples and code. A high-level summary:
tabpackage.trainis the central function of the package. Everything else either usestabpackage.trainor is used bytabpackage.train.tabpackage.sklearnprovides scikit-learn estimators that are thin wrappers aroundtabpackage.train.- The remaining components provide building blocks for implementing TabPack-like systems.
Examples
examples/tabpack.pyis a well-documented end-to-end example covering TabPack training and export.examples/tabpack_sklearn.ipynb(Colab) showcases scikit-learn API for TabPack.tabpackage._trainingis the reference TabPack training implementation that can be copied and customized as needed.- The following classes form a good set of examples showing how to implement module packs:
tabpackage.nn.DropoutPack: a pack of dropout layers with different dropout rates.tabpackage.nn.LinearPack: a pack of linear layers with different input and output sizes.tabpackage.nn.MLPBackbonePack: a pack of MLP backbones with different depth, width and dropout rates.tabpackage.nn.TabPack: a pack of full-fledged tabular MLPs with different hyperparameters. Pay extra attention to the use oftabpackage.nn.PackViewin this module.
How to cite
@inproceedings{gorishniy2026tabpack,
title={{TabPack: Efficient Hyperparameter Ensembles for Tabular Deep Learning}},
author={Yury Gorishniy and Akim Kotelnikov and Ivan Rubachev and Artem Babenko},
booktitle={ICML},
year={2026},
}
Metadata
Release files for tabpackage 0.0.2.dev0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| tabpackage-0.0.2.dev0.tar.gz | 85.6 kB | Without provenance | Details for tabpackage-0.0.2.dev0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| tabpackage-0.0.2.dev0-py3-none-any.whl | Python 3 | none | any | Details for tabpackage-0.0.2.dev0-py3-none-any.whl |
Total release size: 174.7 kB
Release files / tabpackage-0.0.2.dev0.tar.gz
| Download URL | tabpackage-0.0.2.dev0.tar.gz |
|---|---|
| Size | 85.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7ab57f378729e39357e569ce8a454353b3bdc2cc9171a7a969492167bbdcbb73
|
|
BLAKE2b-256 checksum How to use checksums |
758458724869347ca1dbc3e7d28a1148f9a44593498cfab77b07066fd13bd86f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.13.7 {"installer":{"name":"uv","version":"0.13.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / tabpackage-0.0.2.dev0-py3-none-any.whl
| Download URL | tabpackage-0.0.2.dev0-py3-none-any.whl |
|---|---|
| Size | 89.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7772c0e7883fd8d47e930ba85a57c604d8c10959af34b9f22f4d834cf08934bc
|
|
BLAKE2b-256 checksum How to use checksums |
184b2f0b286aa5aeb43dee764122e18de0f306e5139703f8d575acc6f33efdd7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.13.7 {"installer":{"name":"uv","version":"0.13.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Security for tabpackage 0.0.2.dev0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.