Skip to main content

A tool for deploying and running AI models to Modal

Project description

PlumAI - Deploy and Run AI Models

Banner

PlumAI is a CLI tool that allows you to deploy and run AI models to Modal. It's completely free and open-source.

Table of Contents

Changelog

[Aug 10, 2024] - 🎉 Added support for Flux models.

Supported Platforms

PlumAI currently supports Linux, macOS, and Windows.

Installation

To install PlumAI, follow these steps:

  1. Verify System Requirements:
  • Python 3: Ensure Python 3 is installed on your system.
  1. Install PlumAI:
pip install plumai

This command installs PlumAI directly from the GitHub repository, including all necessary dependencies.

Usage

After installation, you can use PlumAI with the following commands:

Run a Flux model

plumai run [MODEL_NAME] [GPU_TYPE] [-f | --force]

# For example:
plumai run flux.1-dev A10G
  • MODEL_NAME: Specify the model name to run. Options are:

    • flux.1-dev (default)
    • flux.1-schnell
  • GPU_TYPE: Specify the GPU type to use. Options are:

    • T4 (not recommended)
    • A10G (default)
    • A100
    • L4
    • H100
  • f | --force: Use this option to force redeployment of the model, ignoring the cache. If the model has already been deployed and cached, using --force will trigger a new deployment process.

Troubleshooting

  • Git or Python3 not installed: If you encounter errors related to missing Git or Python3, install them using your system's package manager. For example, on Debian-based systems:
sudo apt-get update
sudo apt-get install -y git python3 python3-pip
  • Modal Setup Issues: If you encounter issues with Modal, ensure it is properly configured and installed. Refer to Modal's documentation for setup instructions.

License

This project is licensed under the MIT License.

Contributing

Contributions are welcome! Please submit issues or pull requests to the repository here.

Contact

For questions or support, please contact me via Twitter/X

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

plumai-0.1.13.tar.gz (13.4 kB view details)

Uploaded Source

Built Distribution

plumai-0.1.13-py3-none-any.whl (15.3 kB view details)

Uploaded Python 3

File details

Details for the file plumai-0.1.13.tar.gz.

File metadata

  • Download URL: plumai-0.1.13.tar.gz
  • Upload date:
  • Size: 13.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for plumai-0.1.13.tar.gz
Algorithm Hash digest
SHA256 cf335d53513c37c2d3adf5aeb19429d3bf69acd65f5ffb2e00d88c58ced7eadc
MD5 e9ac3f2371ae07997067664b25b7a06a
BLAKE2b-256 fa3bed4ddd631973b169db19f7e266d2770042313053bf1baf175c7d6af5964f

See more details on using hashes here.

File details

Details for the file plumai-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: plumai-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 15.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.19

File hashes

Hashes for plumai-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 83eac221d7471cc4dbeb9ad755a90b65a9066a096a5c4a41af04124506cee392
MD5 6cb6ed7aca1f313db4657c7dcbed7068
BLAKE2b-256 5ad3c2ba6b59f9b1b99561312841add6d1f65c332d229ad445b6efc628c40cf1

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page