Skip to main content

Abed is an automated system for benchmarking machine learning algorithms. It is created for running experiments where it is desired to run multiple methods on multiple datasets using multiple parameters. It includes automated processing of result files into result tables. Abed was designed for use with the Dutch LISA supercomputer, but can hopefully be used on any Torque compute cluster.

Abed was created as a way to automate all the tedious work necessary to set up proper benchmarking experiments. It also removes much of the hassle by using a single configuration file for the experimental setup. A core feature of Abed is that it doesn’t care about which language the tested methods are written in.

Abed can create output tables as either simple txt files, or as html pages using the excellent DataTables plugin. To support offline operation the necessary DataTables files are packaged with Abed.

Documentation

For Abed’s documentation, see the documentation.

Screenshots

Rank plots in Abed Result tables in Abed Result tables in Abed (time)

Notes

The current version of Abed is very usable. However, it is still considered beta software, as it is not yet completely documented and some robustness improvements are planned. For a similar and more mature project which works with R see: BatchExperiments.

Metadata

Release files for abed 0.0.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for abed 0.0.3
File Size Uploaded
abed-0.0.3.tar.gz 1.1 MB Details

Release files / abed-0.0.3.tar.gz

Download URL abed-0.0.3.tar.gz
Size 1.1 MB
Tags Source
SHA-256 checksum
How to use checksums
334d9a9775e216ed5abbe8abe4c00381e09eed03ce8fff665da3e0f81de2447c
BLAKE2b-256 checksum
How to use checksums
fc11e521077e0f42dc9c03e7f43c895ebfa8ec03381a59ab1faee1253273dc42
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

0.1.3

1 release file

0.1.2

1 release file

0.1.1

1 release file

0.1.0

1 release file

This release

0.0.3 This release

1 release file

0.0.2

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page