Easy Model Deployer: Easy Foundation Model Hosting on AWS
Introduction
Easy Model Deployer is a lightweight tool designed for simplify deploy Open-Source LLMs (Supported Models) and Custom Models on AWS. It provides OpenAI's Completions API and LangChain Interface. Built for developers who need reliable and scalable model serving without complex environment setup.
Key Features
- One-click deployment of models to AWS (Amazon SageMaker, Amazon ECS, Amazon EC2)
- Diverse model types (LLMs, VLMs, Embeddings, Vision, etc.)
- Rich inference engine (vLLM, TGI, Lmdeploy, etc.)
- Different instance types (CPU/GPU/AWS Inferentia)
- Convenient integration (OpenAI Compatible API, LangChain client, etc.)
Supported Models
Easy Model Deployer supports a wide range of models including:
- LLMs: Qwen, Llama, DeepSeek, GLM, InternLM, Baichuan, and more
- Vision-Language Models: Qwen-VL, InternVL, Gemma3-Vision, and more
- Embedding Models: BGE, Jina, BERT-based models
- Reranking Models: BGE-Reranker, Jina-Reranker
- ASR Models: Whisper variants
- Custom Models: Support for custom Docker images
For the complete list of supported models and deployment configurations, see Supported Models.
🔧 Get Started
Installation
Install Easy Model Deployer with PyPI, currently support for Python 3.9 or above:
pip install easy-model-deployer
emd
Bootstrap
Prepare the essential resources required for model deployment.
For more information, please refer to Architecture.
emd bootstrap
💡 Tip Once you upgrade the EMD by
pip, you need to run this command again to update the environment.
Deploy Models
Deploy models with an interactive CLI or one command line.
emd deploy
💡 Tip To view all available parameters, run
emd deploy --help. When you see the message "Waiting for model: ...", it means the deployment task has started and you can stop the terminal output by pressingCtrl+C.
- For more information on deployment parameters, please refer to the Deployment parameters.
- For best practice examples of using command line parameters, please refer to the Best Deployment Practices.
Show Status
Check the status of the model deployment task.
emd status
💡 Tip The EMD allows launch multiple deployment tasks simultaneously.
Invocation
Invoke the deployed model for testing by CLI.
emd invoke <ModelId>
💡 Tip You can find the ModelId in the output by
emd status. For example:emd invoke DeepSeek-R1-Distill-Qwen-1.5B
💡 Tip OpenAI Compatible API is supported only for Amazon ECS and Amazon EC2 deployment types.
List Supported Models
Quickly see what models are supported, this command will output all information related to deployment. (Please browse Supported Models for more information.)
emd list-supported-models
Delete Model
Delete the deployed model.
emd destroy <ModelId>
💡 Tip You can find the ModelId in the output by
emd status. For example:emd destroy DeepSeek-R1-Distill-Qwen-1.5B
📖 Documentation
For advanced configurations and detailed guides, visit our documentation site.
🤝 Contributing
We welcome contributions! Please see CONTRIBUTING.md for guidelines.
Release files for easy-model-deployer 0.9.47
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| easy_model_deployer-0.9.47.tar.gz | 229.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| easy_model_deployer-0.9.47-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 544.4 kB
Release files / easy_model_deployer-0.9.47.tar.gz
| Download URL | easy_model_deployer-0.9.47.tar.gz |
|---|---|
| Size | 229.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
62cee12bf41a2089e8712f954760b2e3536829710aa3300773864b1d99a38458
|
|
BLAKE2b-256 checksum How to use checksums |
3b534e940dfc493ad12a1857d33091ec87033c8c1f6f585828808d5713d54cbe
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.14.0 Linux/6.11.0-1018-azure
|
Release files / easy_model_deployer-0.9.47-py3-none-any.whl
| Download URL | easy_model_deployer-0.9.47-py3-none-any.whl |
|---|---|
| Size | 314.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
48dded1ec75df4640e9672ceca007ac2b209e20470578a167fd16ae355bc87fd
|
|
BLAKE2b-256 checksum How to use checksums |
cdc4ae9ac1993d24ed57937fbaa4df547d580ccd6c814db53b08b3e3609a2bd2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.2.1 CPython/3.14.0 Linux/6.11.0-1018-azure
|
