Skip to main content

`FluffyModel` is a user-friendly CLI tool designed to seamlessly set up an inference endpoint for open-source ML models. It leverages Gradio and Hugging Face spaces to achieve this.

Project description

FluffyModel

PyPI version

FluffyModel is a user-friendly CLI tool designed to seamlessly set up an inference endpoint for open-source ML models. It leverages Gradio and Hugging Face spaces to achieve this.

As a developer, you might have wanted to integrate ML models into your web and mobile apps. However, doing so usually necessitates hosting the ML model on some platform. While there are numerous hosting providers available, including industry giants like Amazon AWS and Google GCP, the process can be intricate. Often, it demands the construction of a custom Flask REST API.

FluffyModel simplifies this process. It aids in creating, structuring, and setting up a Hugging Face space for swift deployment. With a single command, users can automate the typically manual process of creating and configuring a new Hugging Face space complete with a REST API endpoint.

Table of Contents

Features

  • REST API endpoint: Use the endpoint to run an inference from any language.
  • Space Creation: Quickly create a new Hugging Face space.
  • Predefined Structure: Automatically structure the space with necessary files such as requirements.txt, README.md, and app.py.
  • Easy Deployment: Commit and push changes to the space in one go.
  • Virtual Environment Setup: Automatically set up a virtual environment within the space, ensuring dependencies are isolated.

Prerequisites

Before using FluffyModel, ensure you have:

  • Python 3.x installed.
  • git installed and available in your system's PATH.
  • A Hugging Face account and a corresponding API token.

Installation

pip install fluffymodel

Usage

Once installed, 'FluffyModel' can be used with a single command, where 'git-name' is name of the repository on huggingface.co. e.g. If you want to create an endpoint for Facebook's resnet , then the gitname would be facebook/detr-resnet-50

fluffymodel <git-name>

Here's what happens next:

  • Space Creation: A new Hugging Face space will be created.
  • Repository Configuration: The repository of the space is cloned, structured, and a virtual environment is set up.
  • Push & Deploy: All changes are committed and pushed to the space.
  • Instructions Display: A URL to the space and a curl command for the inference endpoint are displayed. Users can visit the URL to monitor the build and later test the endpoint using the provided curl command.

Contributing

If you have suggestions, bug reports, or enhancements, please:

  • Open an Issue: Before making any changes, open an issue in the GitHub repository to discuss your proposed changes.
  • Fork & Clone: Fork the repository, clone it locally, and set up a virtual environment.
  • Make Changes: Implement your changes and test them thoroughly.
  • Submit a Pull Request: Once you're satisfied with your changes, submit a pull request for review.

License

'FluffyModel' is licensed under the MIT License. All rights reserved.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fluffymodel-0.1.17.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fluffymodel-0.1.17-py3-none-any.whl (6.0 kB view details)

Uploaded Python 3

File details

Details for the file fluffymodel-0.1.17.tar.gz.

File metadata

  • Download URL: fluffymodel-0.1.17.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.10.12 Darwin/22.6.0

File hashes

Hashes for fluffymodel-0.1.17.tar.gz
Algorithm Hash digest
SHA256 e3be80a1df837c38c4f1751a1c8bf23cf375cb9913f5e3af4da0d0e2bfd778f3
MD5 babbf943b5aade01cf8094ad114b1f68
BLAKE2b-256 ccfc2b27d10a087b45be1c38089c80dfe5f2dcc337ecdc895e95e51aadcbb118

See more details on using hashes here.

File details

Details for the file fluffymodel-0.1.17-py3-none-any.whl.

File metadata

  • Download URL: fluffymodel-0.1.17-py3-none-any.whl
  • Upload date:
  • Size: 6.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.10.12 Darwin/22.6.0

File hashes

Hashes for fluffymodel-0.1.17-py3-none-any.whl
Algorithm Hash digest
SHA256 2a4744bc17112ed317417dc400d9e6454d8a1b7fddd74775999d7380d2eeddb3
MD5 c4a73d87e25d83ccb35abb3c1a9b161b
BLAKE2b-256 ce073b88a5c2b2cb752e93280eeebbc2f5b98d2171b561b24202be57c07af330

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page