ML Workflow
ML workflow contains our process of bringing a project to fruition as efficiently as possible. This is subject to change as we iterate and improve. This package implements tools and missing features to help bridge the gap between frameworks and libraries that we utilize.
The main packages and tools that we build around are:
pytorch
ignite
pytorch-datastream
guild
See the documentation for more information.
Install in existing project
pip install ml-workflowCreate new project with MNIST template
mkdir new-project
cd new-project
virtualenv venv -p python3.8
source venv/bin/activate
pip install ml-workflow
python -m workflow.setup_project
pip install -r requirements.txt
pip install -r dev_requirements.txt
pip freeze > dev_requirements.txt
# reactivate environment to find guild
deactivate
source venv/bin/activateYou can train a model and inspect the training with:
guild run prepare
guild run train
guild tensorboardDevelopment
Prepare and run tests
git clone git@github.com:aiwizo/ml-workflow.git
cd ml-workflow
virtualenv venv --python python3.8
source venv/bin/activate
pip install -r requirements.txt
pip install -r dev_requirements.txt
pip install pytest
python -m pytestTest template
./setup_template.py
./test_template.pyUse development version in project
The following steps will create a link to the local directory and any changes made to the package there will directly carry over to your project environment.
cd path/to/my/project
source venv/bin/activate
cd path/to/work/area
git clone git@github.com:aiwizo/ml-workflow.git
cd ml-workflow
pip install -e .1 maintainer
Metadata
1 maintainer
Release files for ml-workflow 0.8.4
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| ml_workflow-0.8.4-py3-none-any.whl | Python 3 | none | any | Details |
Release files / ml_workflow-0.8.4-py3-none-any.whl
| Download URL | ml_workflow-0.8.4-py3-none-any.whl |
|---|---|
| Size | 55.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e57129757a08a821770274ec96a484591c4134795494e42d6d8f3818b4197505
|
|
BLAKE2b-256 checksum How to use checksums |
7e40b6bfa52b16e13b9aae021daef38c025c4b3a6958c7a626e7137d0dee793a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.6
|
