`FluffyModel` is a user-friendly CLI tool designed to seamlessly set up an inference endpoint for open-source ML models. It leverages Gradio and Hugging Face spaces to achieve this.
Project description
FluffyModel
FluffyModel is a user-friendly CLI tool designed to seamlessly set up an inference endpoint for open-source ML models. It leverages Gradio and Hugging Face spaces to achieve this.
As a developer, you might have wanted to integrate ML models into your web and mobile apps. However, doing so usually necessitates hosting the ML model on some platform. While there are numerous hosting providers available, including industry giants like Amazon AWS and Google GCP, the process can be intricate. Often, it demands the construction of a custom Flask REST API.
FluffyModel simplifies this process. It aids in creating, structuring, and setting up a Hugging Face space for swift deployment. With a single command, users can automate the typically manual process of creating and configuring a new Hugging Face space complete with a REST API endpoint.
Table of Contents
Features
- REST API endpoint: Use the endpoint to run an inference from any language.
- Space Creation: Quickly create a new Hugging Face space.
- Predefined Structure: Automatically structure the space with necessary files such as
requirements.txt,README.md, andapp.py. - Easy Deployment: Commit and push changes to the space in one go.
- Virtual Environment Setup: Automatically set up a virtual environment within the space, ensuring dependencies are isolated.
Prerequisites
Before using FluffyModel, ensure you have:
- Python 3.x installed.
gitinstalled and available in your system's PATH.- A Hugging Face account and a corresponding API token.
Installation
pip install fluffymodel
Usage
Once installed, 'FluffyModel' can be used with a single command, where 'git-name' is name of the repository on huggingface.co. e.g. If you want to create an endpoint for Facebook's resnet , then the gitname would be facebook/detr-resnet-50
fluffymodel <git-name>
Here's what happens next:
- Space Creation: A new Hugging Face space will be created.
- Repository Configuration: The repository of the space is cloned, structured, and a virtual environment is set up.
- Push & Deploy: All changes are committed and pushed to the space.
- Instructions Display: A URL to the space and a curl command for the inference endpoint are displayed. Users can visit the URL to monitor the build and later test the endpoint using the provided curl command.
Contributing
If you have suggestions, bug reports, or enhancements, please:
- Open an Issue: Before making any changes, open an issue in the GitHub repository to discuss your proposed changes.
- Fork & Clone: Fork the repository, clone it locally, and set up a virtual environment.
- Make Changes: Implement your changes and test them thoroughly.
- Submit a Pull Request: Once you're satisfied with your changes, submit a pull request for review.
License
'FluffyModel' is licensed under the MIT License. All rights reserved.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file fluffymodel-0.1.17.tar.gz.
File metadata
- Download URL: fluffymodel-0.1.17.tar.gz
- Upload date:
- Size: 5.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.12 Darwin/22.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e3be80a1df837c38c4f1751a1c8bf23cf375cb9913f5e3af4da0d0e2bfd778f3
|
|
| MD5 |
babbf943b5aade01cf8094ad114b1f68
|
|
| BLAKE2b-256 |
ccfc2b27d10a087b45be1c38089c80dfe5f2dcc337ecdc895e95e51aadcbb118
|
File details
Details for the file fluffymodel-0.1.17-py3-none-any.whl.
File metadata
- Download URL: fluffymodel-0.1.17-py3-none-any.whl
- Upload date:
- Size: 6.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.12 Darwin/22.6.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2a4744bc17112ed317417dc400d9e6454d8a1b7fddd74775999d7380d2eeddb3
|
|
| MD5 |
c4a73d87e25d83ccb35abb3c1a9b161b
|
|
| BLAKE2b-256 |
ce073b88a5c2b2cb752e93280eeebbc2f5b98d2171b561b24202be57c07af330
|