Skip to main content

TabReD: Benchmark of industry-grade tabular datasets

Project description

TabReD overview

TabReD: Analyzing Pitfalls and Filling the Gaps in Tabular Deep Learning Benchmarks

TabReD is a collection of eight industry-grade tabular datasets designed to evaluate machine learning methods under more realistic conditions: temporal distribution shift, rich feature sets from feature engineering pipelines, closer aligned with some real world applications of tabular machine learning.

:scroll: arXiv :books: Other tabular DL projects

[!NOTE] Download preprocessed TabReD datasets with one command

uvx tabred download all
# or individual datasets with
uvx tabred download cooking-time weather

You need a Kaggle account and an API token at ~/.kaggle/kaggle.json for this to work.

Datasets

Dataset Features Task Instances Used Instances Available Source
Homesite Insurance 299 Classification 260,753 - Competition
Ecom Offers 119 Classification 160,057 - Competition
Homecredit Default 696 Classification 381,664 1,526,659 Competition
Sberbank Housing 392 Regression 28,321 - Competition
Cooking Time 192 Regression 319,986 12,799,642 Dataset
Delivery ETA 223 Regression 416,451 17,044,043 Dataset
Maps Routing 986 Regression 340,981 13,639,272 Dataset
Weather 103 Regression 423,795 16,951,828 Dataset

Preprocessed data format

The downloader unpacks each dataset into its own directory:

data/<dataset>/
├── info.json
├── x_num.npy
├── x_cat.npy          # when present
├── x_bin.npy          # when present
├── x_meta.npy
├── y.npy
└── splits/
    ├── default/
    │   ├── train.npy
    │   ├── val.npy
    │   └── test.npy
    ├── random-{0,1,2}/
    │   ├── train.npy
    │   ├── val.npy
    │   └── test.npy
    └── sliding-window-{0,1,2}/
        ├── train.npy
        ├── val.npy
        └── test.npy

The x_*.npy files contain feature matrices, y.npy contains targets, and info.json contains task metadata. Split files contain row indices into these arrays. The default split is the main split from the TabReD paper; the random and sliding-window splits are provided for split-strategy studies.

Repository structure

  • src/tabred: downloader package and CLI.
  • paper: code for reproducing the paper

Rebuilding datasets from raw sources

Most users should use the preprocessed downloader above. The preprocessing pipeline is kept in this repository for reproducibility and maintenance, but it is not the recommended way to obtain the benchmark data.

The cleaned-up dataset preparation scripts will be published in a few days (@puhsu 10.07.26). For now consult the previous commits and the preprocessing folder there.

Citation

If you use TabReD, please cite:

@inproceedings{
 rubachev2025tabred,
 title={TabReD: Analyzing Pitfalls and Filling the Gaps in Tabular Deep Learning Benchmarks},
 author={Ivan Rubachev and Nikolay Kartashev and Yury Gorishniy and Artem Babenko},
 booktitle={The Thirteenth International Conference on Learning Representations},
 year={2025},
 url={https://openreview.net/forum?id=L14sqcrUC3}
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tabred-0.1.1.tar.gz (13.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tabred-0.1.1-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file tabred-0.1.1.tar.gz.

File metadata

  • Download URL: tabred-0.1.1.tar.gz
  • Upload date:
  • Size: 13.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tabred-0.1.1.tar.gz
Algorithm Hash digest
SHA256 388529b748199077d89febc9be8db4a8786131171df9e2ac49a9e87b11ed8583
MD5 486b143ec7d36adcdcefd0cb1a873b60
BLAKE2b-256 d81383fccb7c79468d4efe80d76bbb867a54e258d1341c30b14d5d7bc88bd026

See more details on using hashes here.

File details

Details for the file tabred-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: tabred-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 13.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tabred-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3a9ba8aeda509cb85036073dfb6c4b6186bd169bd51f306d7608b91c549d3558
MD5 e35992abbe8c744e1fa0e9e470581e6a
BLAKE2b-256 08569e7fd5358766adf3b14d58d3196421aeff56c3a5b264e02ad38b49d56a3b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page