Skip to main content

Project Structure for MLflow integrated ML Projects

This cli tool generates the following directory structure for quickstart ML projects

installaton:

pip install aihubcli

example use:
aihubcli create myProject

myProject/
│
├── input/
│   ├── raw/                <-- Raw data here
│   ├── interim/            <-- Any intermediate data, to pause and continue experiments
│   └── processed/          <-- Processed data ready for ML pipeline
│
├── output/
│   ├── models/             <-- Model pickle or model weights stored here
│   ├── artifacts/          <-- Serialized artifacts like LabelEncoder, Vectorizer etc
│   ├── figures /            <-- All plots and visualizations goes here
│   └── results/            <-- If the results needs to be stored for review, save here
│
├── notebooks/              <-- All notebooks and experiments resides here
│   ├── eda_plots.ipynb     <-- ┌───────────────────────────────────────────┐
│   ├── ml_rnn.ipynb        <-- │ free to name notebooks any way you prefer │
│   └── ml_seq2seq.ipynb    <-- └───────────────────────────────────────────┘
│
├── src/                    <-- Final program, with training and prediction pipeline
│   ├── __init__.py         <-- Makes src a Python module                    
│   ├── preprocess.py       <-- code related to preprocessing the data and storing it in input/processed/
│   ├── model.py            <-- model definition here, can be used in train or prediction
│   ├── train.py            <-- all code related to training model goes here
│   ├── hyperopt.py         <-- hyperparameter optimizations related code
│   ├── package.py          <-- packaging the trained model with preprocessing logic for MLflow
│   ├── predict.py          <-- prediction logic, usually loads the model from Mlflow registry and predict
│   └── server.py           <-- any API interface like Flask etc. Create as needed
│
README.md                   <-- Description and instruction about the project
MLProject                   <-- MLflow project file. If you want to use this directory as MLflow project
requirements.txt            <-- python dependencies
config.yml                  <-- configuration key value pairs in yaml format

Release files for aihubcli 1.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for aihubcli 1.0.1
File Size Uploaded
aihubcli-1.0.1.tar.gz 5.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for aihubcli 1.0.1
File Interpreter ABI Platform
aihubcli-1.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 10.6 kB

Release files / aihubcli-1.0.1.tar.gz

Download URL aihubcli-1.0.1.tar.gz
Size 5.2 kB
Tags Source
SHA-256 checksum
How to use checksums
443b0141dd1da259bf409b74bbba6122bfc24c861bae84d5eba39292892afa1b
BLAKE2b-256 checksum
How to use checksums
6cdcf43f82dc31e15da66dfa4ef26f96f0ab28481bb53a9f13a85aa04583bcdb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

Release files / aihubcli-1.0.1-py3-none-any.whl

Download URL aihubcli-1.0.1-py3-none-any.whl
Size 5.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
cceaa3067f2c08d776c770244b16adef8daff5bb4f585cc33639982ec44817ec
BLAKE2b-256 checksum
How to use checksums
33822e57175ee61c0728c5249141761a02db68c236fabe0661631a60078c2b05
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.6.1 requests/2.24.0 requests-toolbelt/0.9.1 tqdm/4.50.2 CPython/3.8.5

Release history Release notifications | RSS feed

This release

1.0.1 This release

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page