Skip to main content

TabReD: Benchmark of industry-grade tabular datasets

Project description

TabReD: Analyzing Pitfalls and Filling the Gaps in Tabular Deep Learning Benchmarks

:scroll: arXiv   :books: Other tabular DL projects

[!NOTE] Download preprocessed TabReD datasets with one command

uvx tabred download all
# or individual datasets with
uvx tabred download cooking-time weather

You need a Kaggle account and an API token at ~/.kaggle/kaggle.json for this to work.

TabReD is a collection of eight industry-grade tabular datasets designed to evaluate machine learning methods under more realistic conditions: temporal distribution shift, rich feature sets from feature engineering pipelines, closer aligned with some real world applications of tabular machine learning.

TabReD overview

Datasets

Dataset Features Task Instances Used Instances Available Source
Homesite Insurance 299 Classification 260,753 - Competition
Ecom Offers 119 Classification 160,057 - Competition
Homecredit Default 696 Classification 381,664 1,526,659 Competition
Sberbank Housing 392 Regression 28,321 - Competition
Cooking Time 192 Regression 319,986 12,799,642 Dataset
Delivery ETA 223 Regression 416,451 17,044,043 Dataset
Maps Routing 986 Regression 340,981 13,639,272 Dataset
Weather 103 Regression 423,795 16,951,828 Dataset

Preprocessed data format

The downloader unpacks each dataset into its own directory:

data/<dataset>/
├── info.json
├── x_num.npy
├── x_cat.npy          # when present
├── x_bin.npy          # when present
├── x_meta.npy
├── y.npy
└── splits/
    ├── default/
    │   ├── train.npy
    │   ├── val.npy
    │   └── test.npy
    ├── random-{0,1,2}/
    │   ├── train.npy
    │   ├── val.npy
    │   └── test.npy
    └── sliding-window-{0,1,2}/
        ├── train.npy
        ├── val.npy
        └── test.npy

The x_*.npy files contain feature matrices, y.npy contains targets, and info.json contains task metadata. Split files contain row indices into these arrays. The default split is the main split from the TabReD paper; the random and sliding-window splits are provided for split-strategy studies.

Repository structure

  • src/tabred: downloader package and CLI.
  • paper: code for reproducing the paper

Rebuilding datasets from raw sources

Most users should use the preprocessed downloader above. The preprocessing pipeline is kept in this repository for reproducibility and maintenance, but it is not the recommended way to obtain the benchmark data.

The cleaned-up dataset preparation scripts will be published in a few days (@puhsu 10.07.26). For now consult the previous commits and the preprocessing folder there.

Citation

If you use TabReD, please cite:

@inproceedings{
 rubachev2025tabred,
 title={TabReD: Analyzing Pitfalls and Filling the Gaps in Tabular Deep Learning Benchmarks},
 author={Ivan Rubachev and Nikolay Kartashev and Yury Gorishniy and Artem Babenko},
 booktitle={The Thirteenth International Conference on Learning Representations},
 year={2025},
 url={https://openreview.net/forum?id=L14sqcrUC3}
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tabred-0.1.0.tar.gz (13.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tabred-0.1.0-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file tabred-0.1.0.tar.gz.

File metadata

  • Download URL: tabred-0.1.0.tar.gz
  • Upload date:
  • Size: 13.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tabred-0.1.0.tar.gz
Algorithm Hash digest
SHA256 3ca89a9e268a1be06c0c910189d13debe5479d74f65345475410f24ba3b9742c
MD5 c877af09fccae6ecb36fa0dc933736aa
BLAKE2b-256 4973f2166dc1daba3ddf7fc0fd0489ff8a345a2d4bf7e39596e6b6c22a12afb5

See more details on using hashes here.

File details

Details for the file tabred-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: tabred-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 13.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for tabred-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2b1eddfa25dea3f83e5068ec4eb43274271e5af6987502e212cbf9c63b780d13
MD5 cad4987d68a0a1dd866766abf4ea63ad
BLAKE2b-256 9ca35df5c9e6fb10f3ea8a93ff31b11f2f6ba374b0d24d802049d0019d0649b4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page