MLXP
What is MLXP?
MLXP (Machine Learning eXperimentalist for Python) package is an open-source Python framework for managing multiple experiments with a flexible option structure from launching, and logging to querying results. A full documentation is available in the MLXP’s project page.
Key functionalities
Launching several jobs automatically using hydra and hierarchical configs by adding a single decorator to the main task function.
Logging outputs (metrics, artifacts, checkpoints) of a job in a uniquely assigned directory along with all metadata and configuration options to reproduce the experiment.
Code version management by automatically generating a deployment version of the code based on the latest git commit.
Submitting jobs to a cluster using a job scheduler.
Exploiting the results of several experiments by easily reading, querying, grouping, and aggregating the output of several jobs.
Installing MLXP
You can install MLXP in a virtualenv/conda environment where pip is installed (check which pip):
Stable release
$ pip install MLXPMain branch
$ pip install git+https://github.com/inria-thoth/mlxp@master#egg=mlxpRequirements
Requirements |
|---|
hydra-core |
omegaconf |
tinydb |
setuptools |
PyYAML |
pandas |
ply |
dill |
GitPython |
Documentation
A full documentation is available in the MLXP’s official documentation website. See the following pages for more detailled information:
Quick start guide: for a simple example of how to use MLXP. Tutorial: to get a better understanding of all functionalities provided by MLXP. Documentation: for detailed documentation.
Acknowledgments
Alexandre Zouaoui kindly shared his python implementation for creating job scripts and submiting them to a cluster. His code served as the basis for the implementation of the Scheduling functionality.
Juliette Marrie, Romain Ménégaux and Pierre Wolinski provided valuable feedback and suggestions to improve MLXP.
License
MLXP is distributed under MIT license.
1 maintainer
Release files for MLXP 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| MLXP-0.1.1.tar.gz | 33.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| MLXP-0.1.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 74.1 kB
Release files / MLXP-0.1.1.tar.gz
| Download URL | MLXP-0.1.1.tar.gz |
|---|---|
| Size | 33.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
b194b901d008a13d7e4e56fd562f3ffe5169e9805aa3dad477350ec3b7e192ea
|
|
BLAKE2b-256 checksum How to use checksums |
18ead7329233c9ad362be51f5957a6b483a2afb226f063712346567221c69584
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
Release files / MLXP-0.1.1-py3-none-any.whl
| Download URL | MLXP-0.1.1-py3-none-any.whl |
|---|---|
| Size | 40.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
066121d49d5b3e5863a11c51c8d50b5c87f0d4e0f9191c31b765fb780caa5b0d
|
|
BLAKE2b-256 checksum How to use checksums |
436c7cf83e4492f7da795f778b044239fce1367d679eadcd19ee066ce14cec18
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.11.5
|
