OmniOpt2 - Hyperparameter Optimizer for SLURM-based Systems
OmniOpt2 is a tool designed to assist researchers, engineers, and data scientists with hyperparameter optimization on SLURM-based clusters, even though it works without it as well. It simplifies large-scale optimization tasks with built-in fault tolerance and flexibility. A graphical user interface (GUI) is available for command creation, accessible at OmniOpt2 GUI. For tutorials on configuration, exit codes, and debugging, visit OmniOpt2 Tutorials.
Main program
omniopt --partition=alpha --experiment_name=example --mem_gb=1 --time=60 \
--worker_timeout=60 --max_eval=500 --num_parallel_jobs=500 --gpus=1 \
--follow --run_program=$(echo 'echo "RESULT: %(param)"' | base64 -w0) \
--parameter param range 0 1000 float
This command initiates OmniOpt2 and installs dependencies if not already
installed. The parameter --run_program uses a
Base64-encoded string to
specify commands. It is recommended to use the
GUI, though.
Plot Results
Generates visualizations, such as scatter and hex scatter plots.
--min and --max adjust the plotted result value range.
Or, with --min and --max:
omniopt_plot --run_dir runs/example/0
omniopt_plot --run_dir runs/example/0 --min 0 --max 100
Use Optuna directly
Every Optuna sampler (TPE, CMA-ES, GP, Random, Grid, NSGA-II, NSGA-III, MOTPE, ...) is reachable as a special case of OmniOpt through the omniopt_optuna entry point:
omniopt_optuna --max-eval=20 --parameter 'x range -10 10 int' \
--run-program 'echo "RESULT: $x"'
omniopt_optuna --model=OPTUNA_NSGAII --max-eval=30 \
--result-names RESULT1=min RESULT2=max \
--parameter 'x range 0 5 float'
Under the hood this is just ./omniopt --model=OPTUNA_TPE ...; the entry point adds sensible defaults for every --optuna_* flag and forwards the rest verbatim. See the Optuna integration tutorial for the full surface (pruners, persistent storage, multi-objective, remote control via omniopt_optuna study ...).
Using live-share
Use --live_share (also enablable via GUI) to automatically share the job. You will get a URL
where your job data is hosted publically for 30 days, meaning everyone can access your results,
and you can see all kinds of visualizations and export them.
Run Tests (Developer Use Only)
The test suite simulates various scenarios, including handling faulty jobs and ensuring program resilience.
./tests/main
See the automated tests tutorial page for more details.
Install from pypi
This may not use the bleeding-edge version, but if you get the version from here it means, the test suite has completely tested it properly.
pip3 install omniopt2
Install from repo (bleeding edge, may contain untested changes)
pip3 install -e git+https://github.com/NormanTUD/OmniOpt.git#egg=OmniOpt2
Alternatively, it can be executed directly, as OmniOpt2 will install its dependencies automatically if required.
Error Codes
For common issues and exit codes, see the exit codes tutorial-page.
Autocompletions
Autocomplete files for zsh and bash are in .shells. Run
bash .shells/install
to install them.
Contributions
I'd be glad to see your contributions!
Issues
If you experience any problems, please write issues at my Github Issues page.
Old OmniOpt
The old OmniOpt version, based on HyperOpt, is not supported anymore. It is still available, though, at https://github.com/NormanTUD/LegacyOmniOpt.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file omniopt2-9944.tar.gz.
File metadata
- Download URL: omniopt2-9944.tar.gz
- Upload date:
- Size: 259.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.9.25
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9c9af9bae4bf468ba706e284adfd912107b7b2ca8bba90358dc812eb828d16ec
|
|
| MD5 |
12e326227504f996f5868d50a0cfc394
|
|
| BLAKE2b-256 |
cfa365c7ff481adbbbf4e2eb6b77f77a288628a5ab471ff6f254023d934b4dc1
|
File details
Details for the file omniopt2-9944-py3-none-any.whl.
File metadata
- Download URL: omniopt2-9944-py3-none-any.whl
- Upload date:
- Size: 571.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.9.25
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5f4f1bb83ddea5638c2ba0e5989f7128dab5c4b8772040298be2da8bb12ae474
|
|
| MD5 |
2a7a1b06bbbe564c63b90384bc196150
|
|
| BLAKE2b-256 |
ca6d39264f8fdba9381d6d6bef5be7371d89c89fb0ac81977b7aeb4f82e33e54
|
