Skip to main content

Benchmark your code

Project description

Lab is a Python package for evaluating solvers on benchmark sets. Experiments can run on a single machine or on a computer cluster. The package also contains code for parsing results and creating reports.

The Downward Lab Python package facilitates running experiments for the Fast Downward planning system. It uses the generic experimentation package Lab. Currently, Lab and Downward Lab are distributed together.

Code: https://github.com/aibasel/lab

Documentation: https://lab.readthedocs.io

Cite: please cite Downward Lab by using

@Misc{seipp-et-al-zenodo2017,
  author =       "Jendrik Seipp and Florian Pommerening and
                  Silvan Sievers and Malte Helmert",
  title =        "{Downward} {Lab}",
  publisher =    "Zenodo",
  year =         "2017",
  howpublished = "\url{https://doi.org/10.5281/zenodo.790461}"
}

Install Lab

Lab requires Python 3 and Linux (e.g., Ubuntu). We recommend installing Lab in a Python virtual environment. This has the advantage that there are no modifications to the system-wide configuration, and that you can create multiple environments with different Lab versions (e.g., for different papers) without conflicts:

# Install required packages, including virtualenv.
sudo apt install python3 python3-venv

# Create a new directory for your experiments.
mkdir experiments-for-my-paper
cd experiments-for-my-paper

# If PYTHONPATH is set, unset it to obtain a clean environment.
unset PYTHONPATH

# Create and activate a Python virtual environment for Lab.
python3 -m venv --prompt my-paper .venv
source .venv/bin/activate

# Install Lab in the virtual environment.
pip install -U pip wheel
pip install lab  # or preferably a specific version with lab==x.y

# Store installed packages and exact versions for reproducibility.
# Ignore pkg-resources package (https://github.com/pypa/pip/issues/4022).
pip freeze | grep -v "pkg-resources" > requirements.txt

Please note that before running an experiment script you need to activate the virtual environment with:

source .venv/bin/activate

We recommend clearing the PYTHONPATH variable before activating the virtual environment.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lab-8.4.tar.gz (83.9 kB view details)

Uploaded Source

Built Distribution

lab-8.4-py2.py3-none-any.whl (98.6 kB view details)

Uploaded Python 2Python 3

File details

Details for the file lab-8.4.tar.gz.

File metadata

  • Download URL: lab-8.4.tar.gz
  • Upload date:
  • Size: 83.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for lab-8.4.tar.gz
Algorithm Hash digest
SHA256 3aaacb5fbc2be78443031de7f7455bd6c4e018abc1d64766da698ea4d80cd40b
MD5 1a0bfeefa40a3540da9d03d65080da2b
BLAKE2b-256 1026d071c1ce095b0b13fa88f72e1cb4b0537cd9b92bff562d6051f156389b8e

See more details on using hashes here.

File details

Details for the file lab-8.4-py2.py3-none-any.whl.

File metadata

  • Download URL: lab-8.4-py2.py3-none-any.whl
  • Upload date:
  • Size: 98.6 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.12

File hashes

Hashes for lab-8.4-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 b82fe35938bd4db9f906c804bbb389e3419fc4c6128dfa8f9183cb6a374dd0ef
MD5 9fdcd322eb1bf29a8d9df682d8d2558e
BLAKE2b-256 e76966f0e3aedfc85ddaabba9c1d4a5b213e0052c9795ffa999c16cbb25f9e99

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page