Kaze's MLOps stack
This is an evolving stack of tool I uses for my ML workflow. It is going to be very opinionated, not necessarily always up to date (considering the pace of the field, I think this is fair), and not always the best choice for your use case. I choose this stack because it fits my philosophy and my workflow.
The main purpose of this repo is to serve as a reference to retrace my steps whenever I need, instead of a template which I just copy and deploy to the next project. I have no intention of making this a full fledge library.
Stack
- Machine learning framework: Jax (with Flax for neural networks)
- Hyperparameter tuning : Optax (for optimizers) + Optuna (for hyperparameter tuning)
- Object storage: MinIO (for storing data and models)
- Database: PostgreSQL (for storing metadata and results)
- Experiment tracking: MLflow (for tracking experiments and models)
- Data versioning: DVC (for data versioning and pipelines)
- Orchestration: Dagster (for orchestrating the pipeline)
- Deployment: BentoML (for deploying the model as a service)
- Monitoring: Prometheus (for monitoring the service) + Grafana (for visualizing the metrics)
Metadata
Release files for kazemlstack 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| kazemlstack-0.1.0.tar.gz | 131.7 kB | Without provenance | Details for kazemlstack-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| kazemlstack-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for kazemlstack-0.1.0-py3-none-any.whl |
Total release size: 136.4 kB
Release files / kazemlstack-0.1.0.tar.gz
| Download URL | kazemlstack-0.1.0.tar.gz |
|---|---|
| Size | 131.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6065c52ac430551262e341932ada2b98d43b23638ae028318c7ca0d4778a1b6a
|
|
BLAKE2b-256 checksum How to use checksums |
60cf465eb47392471719cec8f20941b0a3ee0f62a4cdacbf744d8a840b7da46f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Release files / kazemlstack-0.1.0-py3-none-any.whl
| Download URL | kazemlstack-0.1.0-py3-none-any.whl |
|---|---|
| Size | 4.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
54e9da26c3bec4111263dcdf127aa95262d4bd2bb40829e326ed1ab4ae76c5c3
|
|
BLAKE2b-256 checksum How to use checksums |
b13946c42344bba95533546ed0276effcaab5f0641ac2154443ac1bb42ba3292
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Security for kazemlstack 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.