MLE-agent: An agent to automate your MLE processes
Project description
Overview
The project is under active development. The API may change frequently.
MLE-Agent is designed as a pairing LLM agent for machine learning engineers and researchers. It is featured in two major modes:
- :coffee: Baseline Mode is designed to quickly build a baseline model for your AI project.
- :fire: Advanced Mode (Coming Soon) is designed to utilize users' favorite MLOps tools, understand SOTA methods, and suggest optimizations for users' machine learning projects.
Milestones
:rocket: June 1st, 2024: Release the Baseline Mode (v0.1.0)
Get started
Installation
install from pypi
pip install mle-agent
Configuration
You need to set up an LLM and choose tools before using the agent.
mle config
Usage (Baseline Mode)
Create a new project
mle new <project name>
A workspace with <project name>
will be created where you execute the new
command.
Start a project
Debugging on cloud may occur high cost, please make sure you have enough budget.
mle start
You can start a project under any path, the code/data generated will be stored in the target workspace.
Other operations.
mle project ls # show all the available projects
mle project delete <project name> # delete a given project
mle project switch # switch the current working project
Roadmap
The following is a list of features that we plan to implement in the future. The list is not exhaustive, and we may add more features as we go along.
Plan, Generate, Execute and Debug Code
- An easy-to-use CLI interface
- Create/Select/Delete a project
- Understand users' requirements to suggest the file name, dataset, task, model arch, etc
- Generate a detailed coding plan
- Write baseline model code
- Execute the code on the local machine / cloud
- Debug the code and revise the code
- Googling the error message to debug the code
- Data Augmentation
- Hyperparameter tuning
- Model evaluation
More LLMs and Serving tools
- Ollama
- GPT-3.5
- GPT-4
- Codellama
- Codemitral
Better user experience
- web interface (coming soon)
- discord bot
Integrate with AI/ML Tools
- snowflake / databricks
- wandb / mlflow
- skypilot
- dbt / airflow
Integrate with research tools
- huggingface
- paper with code
- arxiv
Contributing
We welcome contributions from the community. We are looking for contributors to help us with the following tasks:
- Benchmark and Evaluate the agent
- Add more features to the agent
- Improve the documentation
- Write tests
If you are interested in contributing, please check the CONTRIBUTING.md file.
Support and Community
- Discord community. If you have any questions, please feel free to ask in the Discord community.
- Twitter. Follow us on Twitter to get the latest updates.
License
Check LICENSE file for more information.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for mle_agent-0.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff251fbcee7a375c6c5907bdd238ceb5e5d4001e845a06aaeb80bd1d2b3e5db8 |
|
MD5 | f9f6892821c3700670ffb571e0b5bfa7 |
|
BLAKE2b-256 | 28ecccf7aa1b54ab6fa6fc2dd8b29fecb8d2dec0bcbda39bc97cbbb3e4d5b4c3 |