Project Structure for MLflow integrated ML Projects
This cli tool generates the following directory structure for quickstart ML projects
installaton:
pip install aihubcli
example use:
aihubcli create myProject
myProject/
│
├── input/
│ ├── raw/ <-- Raw data here
│ ├── interim/ <-- Any intermediate data, to pause and continue experiments
│ └── processed/ <-- Processed data ready for ML pipeline
│
├── output/
│ ├── models/ <-- Model pickle or model weights stored here
│ ├── artifacts/ <-- Serialized artifacts like LabelEncoder, Vectorizer etc
│ ├── figures / <-- All plots and visualizations goes here
│ └── results/ <-- If the results needs to be stored for review, save here
│
├── notebooks/ <-- All notebooks and experiments resides here
│ ├── eda_plots.ipynb <-- ┌───────────────────────────────────────────┐
│ ├── ml_rnn.ipynb <-- │ free to name notebooks any way you prefer │
│ └── ml_seq2seq.ipynb <-- └───────────────────────────────────────────┘
│
├── src/ <-- Final program, with training and prediction pipeline
│ ├── __init__.py <-- Makes src a Python module
│ ├── preprocess.py <-- code related to preprocessing the data and storing it in input/processed/
│ ├── model.py <-- model definition here, can be used in train or prediction
│ ├── train.py <-- all code related to training model goes here
│ ├── hyperopt.py <-- hyperparameter optimizations related code
│ ├── package.py <-- packaging the trained model with preprocessing logic for MLflow
│ ├── predict.py <-- prediction logic, usually loads the model from Mlflow registry and predict
│ └── server.py <-- any API interface like Flask etc. Create as needed
│
README.md <-- Description and instruction about the project
MLProject <-- MLflow project file. If you want to use this directory as MLflow project
requirements.txt <-- python dependencies
config.yml <-- configuration key value pairs in yaml format
Release files for aihubcli 1.0.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| aihubcli-1.0.1.tar.gz | 5.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| aihubcli-1.0.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 10.6 kB
Release files / aihubcli-1.0.1.tar.gz
| Download URL | aihubcli-1.0.1.tar.gz |
|---|---|
| Size | 5.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
443b0141dd1da259bf409b74bbba6122bfc24c861bae84d5eba39292892afa1b
|
|
BLAKE2b-256 checksum How to use checksums |
6cdcf43f82dc31e15da66dfa4ef26f96f0ab28481bb53a9f13a85aa04583bcdb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5
|
Release files / aihubcli-1.0.1-py3-none-any.whl
| Download URL | aihubcli-1.0.1-py3-none-any.whl |
|---|---|
| Size | 5.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
cceaa3067f2c08d776c770244b16adef8daff5bb4f585cc33639982ec44817ec
|
|
BLAKE2b-256 checksum How to use checksums |
33822e57175ee61c0728c5249141761a02db68c236fabe0661631a60078c2b05
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5
|