GraphBench: Next-generation graph learning benchmarking

This is the package associated with the paper GraphBench: Next generation graph learning benchmarking.

It contains the code and tools needed to load the benchmark's datasets. GraphBench is a collection of benchmarking datasets across domains and tasks obtained from real-world and synthetic applications.

Features

GraphBench comes as a Python package with the following features:


Data Loading	Efficiently loads graph datasets for benchmarking and experimentation across all domains and tasks.
Metric Evaluation	Supports a wide range of evaluation metrics for graph learning tasks.
Automated Model Tuning	Integrates SMAC3 for automatic hyperparameter optimization of user models.

Installation

We recommend using Anaconda/Miniconda during setup. The installation process is done in two steps:

Install swig via Anaconda/Miniconda (if using the optimization module): conda install swig
GraphBench can then be easily installed using the Python package manager pip: pip install graphbench-lib

For using the optimization module graphbench-lib[tuning], it needs to be installed instead.

Please make sure to install GraphBench before running the benchmark for the best results. Alternatively, one can also install from source:

git clone https://github.com/graphbench/package
cd package
pip install -e .

Dependencies

GraphBench uses several Python packages to load and process datasets. An overview of the required packages can be found in the list below:

torch
torch_geometric
networkx
torchmetrics
numpy
pandas
requests
tqdm
scikit-learn

Optionally, SMAC3 is used for the optimization module.

Usage

The package can be easily used to get selected datasets from the GraphBench tasks:

import graphbench
Loader = graphbench.Loader(root, dataset_name)
datasets = Loader.load()

Furthermore, standardized evaluation metrics can be obtained using the following methods:

Evaluator = graphbench.Evaluator(metric_name)
metric_results = Evaluator.evaluate()

In order to use all datasets of a domain easily, each domain corresponds to one dataset_name variable:

Domain	Dataset_name
Social media	socialnetwork
Combinatorial optimization	co
SAT solving	sat
Algorithmic reasoning	algorithmic_reasoning_easy, algorithmic_reasoning_medium, algorithmic_reasoning_hard
Electronic circuits	electronic_circuits
Chip design	chipdesign
Weather forecasting	weather

Note that for algorithmic reasoning, the download always includes all datasets for a given task. We plan to change this in the future.

For a complete list of the datasets, see the accompanying website or the datasets.csv file. The corresponding metrics are in the master.csv file.

Citing GraphBench:

If you use GraphBench or GraphBench datasets in your work, please cite our paper:

@article{GraphBench,
title={GraphBench: Next-generation graph learning benchmarking}, 
author={Timo Stoll and Chendi Qian and Ben Finkelshtein and Ali Parviz and Darius Weber and Fabrizio Frasca and Hadar Shavit and Antoine Siraudin and Arman Mielke and Marie Anastacio and Erik Müller and Maya Bechler-Speicher and Michael Bronstein and Mikhail Galkin and Holger Hoos and Mathias Niepert and Bryan Perozzi and Jan Tönshoff and Christopher Morris},
year={2025},
journal={arXiv preprint arXiv:2512.04475}
}

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

graphbench_lib-0.2.0.tar.gz (76.7 kB view details)

Uploaded Jul 6, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

graphbench_lib-0.2.0-py3-none-any.whl (96.6 kB view details)

Uploaded Jul 6, 2026 Python 3

File details

Details for the file graphbench_lib-0.2.0.tar.gz.

File metadata

Download URL: graphbench_lib-0.2.0.tar.gz
Upload date: Jul 6, 2026
Size: 76.7 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for graphbench_lib-0.2.0.tar.gz
Algorithm	Hash digest
SHA256	`4c4eeb44df90bad5ad12c436ef875e34934049763b862be791961233581cf2d9`
MD5	`318c1db5660cc36d591628f8409b0070`
BLAKE2b-256	`8b2ee76dcff23ff7d16d130de88bf686d0e6de6b08967f7742aa3df2e8355157`

See more details on using hashes here.

Provenance

The following attestation bundles were made for graphbench_lib-0.2.0.tar.gz:

Publisher: publish.yml on graphbench/package

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: graphbench_lib-0.2.0.tar.gz
- Subject digest: 4c4eeb44df90bad5ad12c436ef875e34934049763b862be791961233581cf2d9
- Sigstore transparency entry: 2084407886
- Sigstore integration time: Jul 6, 2026
Source repository:
- Permalink: graphbench/package@0d2b60bef0b763fd168222146bac15283465710c
- Branch / Tag: refs/heads/main
- Owner: https://github.com/graphbench
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: publish.yml@0d2b60bef0b763fd168222146bac15283465710c
- Trigger Event: workflow_dispatch