Skip to main content

Machine Learning infra

Project description

Agoge

An opinionated ML development environment

Train pytorch models, hyperparameter tune them with single loc change.

Libraries

Pytorch

Pytorch is a Python first machine learning library

Ray

Ray Provides easy experiment scaling + hyper parameter optimisation

Weights and Biases

Agoge uses WandB to monitor model training. It's super easy to setup, just go to the wandb website and sign up for an account. Then follow the instructions to set up

Static Components

These components should not need to be customised for model specific use cases

Train Worker

Setups all the required components to train a model

Inference Worker

Setups all the required components for inference. Also attempts to download model weights if they are not found locally.

Data Handler

Loads the dataset and handles the dataset split

User Provided Components

These components need to be inherited by project specific classes

Model

Provides some convenience functions around loading models. This class will hold all model specific code and is used by the train worker and inference workers

Solver

Override the solve method with the code required to train your model

Dataset

Any dataset that is compatiable with the Pytorch map style dataset model

Disclaimer

This code is subject to change. I will try not to break anything but can't promise. File an issue if an update breaks your code

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for agoge, version 0.1.2
Filename, size File type Python version Upload date Hashes
Filename, size agoge-0.1.2.tar.gz (7.2 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page