Skip to main content

MLE-agent: An agent to automate your MLE processes

Project description

Keia: A Pair Agent for AI Engineer / Researchers

:love_letter: Fathers' love for Keia :love_letter:

keia-llama

GitHub commit activity PyPI - Downloads GitHub License

Join our Discord community X (formerly Twitter) Follow

Overview

The project is under active development. The API may change frequently.

MLE-Agent is designed as a pairing LLM agent for machine learning engineers and researchers. It is featured in two major modes:

  • :coffee: Baseline Mode is designed to quickly build a baseline model for your AI project.
  • :fire: Advanced Mode (Coming Soon) is designed to utilize users' favorite MLOps tools, understand SOTA methods, and suggest optimizations for users' machine learning projects.

Milestones

:rocket: June 1st, 2024: Release the Baseline Mode (v0.1.0)

Get started

Installation

install from pypi

pip install mle-agent

Configuration

You need to set up an LLM and choose tools before using the agent.

mle config

Usage (Baseline Mode)

Create a new project

mle new <project name>

A workspace with <project name> will be created where you execute the new command.

Start a project

Debugging on cloud may occur high cost, please make sure you have enough budget.

mle start

You can start a project under any path, the code/data generated will be stored in the target workspace.

Other operations.

mle project ls # show all the available projects
mle project delete <project name> # delete a given project
mle project switch # switch the current working project

Roadmap

The following is a list of features that we plan to implement in the future. The list is not exhaustive, and we may add more features as we go along.

Plan, Generate, Execute and Debug Code

  • An easy-to-use CLI interface
  • Create/Select/Delete a project
  • Understand users' requirements to suggest the file name, dataset, task, model arch, etc
  • Generate a detailed coding plan
  • Write baseline model code
  • Execute the code on the local machine / cloud
  • Debug the code and revise the code
  • Googling the error message to debug the code
  • Data Augmentation
  • Hyperparameter tuning
  • Model evaluation

More LLMs and Serving tools

  • Ollama
  • GPT-3.5
  • GPT-4
  • Codellama
  • Codemitral

Better user experience

  • web interface (coming soon)
  • discord bot

Integrate with AI/ML Tools

  • snowflake / databricks
  • wandb / mlflow
  • skypilot
  • dbt / airflow

Integrate with research tools

  • huggingface
  • paper with code
  • arxiv

Contributing

We welcome contributions from the community. We are looking for contributors to help us with the following tasks:

  • Benchmark and Evaluate the agent
  • Add more features to the agent
  • Improve the documentation
  • Write tests

If you are interested in contributing, please check the CONTRIBUTING.md file.

Support and Community

  • Discord community. If you have any questions, please feel free to ask in the Discord community.
  • Twitter. Follow us on Twitter to get the latest updates.

License

Check LICENSE file for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mle_agent-0.1.4.tar.gz (31.8 kB view hashes)

Uploaded Source

Built Distribution

mle_agent-0.1.4-py3-none-any.whl (37.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page