modelforge-finetuning 0.1.0

ModelForge: A no-code toolkit for fine-tuning HuggingFace models

ModelForge 🔧⚡

Finetune LLMs on your laptop’s GPU—no code, no PhD, no hassle.

🚀 Features

• GPU-Powered Finetuning: Optimized for NVIDIA GPUs (even 4GB VRAM).
• One-Click Workflow: Upload data → Pick task → Train → Test.
• Hardware-Aware: Auto-detects your GPU/CPU and recommends models.
• React UI: No CLI or notebooks—just a friendly interface.

📖 Supported Tasks

• Text-Generation: Generates answers in the form of text based on prior and fine-tuned knowledge. Ideal for use cases like customer support chatbots, story generators, social media script writers, code generators, and general-purpose chatbots.
• Summarization: Generates summaries for long articles and texts. Ideal for use cases like news article summarization, law document summarization, and medical article summarization.
• Extractive Question Answering: Finds the answers relevant to a query from a given context. Best for use cases like Retrieval Augmented Generation (RAG), and enterprise document search (for example, searching for information in internal documentation).

Installation

Prerequisites

• Python 3.8+: Ensure you have Python installed.
• NVIDIA GPU: Recommended VRAM >= 6GB.
• CUDA: Ensure CUDA is installed and configured for your GPU.
• Node.js & npm: Required for running the frontend.
• HuggingFace Account: Create an account on Hugging Face and generate a finegrained access token.

Steps

1. Install the Package:

   pip install git+https://github.com
   

2. Set HuggingFace API Key in environment variables:
   Linux:

   export HUGGINGFACE_TOKEN=your_huggingface_token
   

   Windows Powershell:

   $env:HUGGINGFACE_TOKEN="your_huggingface_token"
   

   Windows CMD:

   set HUGGINGFACE_TOKEN=your_huggingface_token
   

   Or use a .env file:

   echo "HUGGINGFACE_TOKEN=your_huggingface_token" > .env
   

3. Install Backend Dependencies:

   cd FastAPI_server
   pip install -r requirements.txt
   

4. Install Frontend Dependencies and build Frontend:

   cd ../Frontend
   npm install
   npm run build
   

5. Run the Backend:

   cd ../FastAPI_server
   uvicorn app:app --host 127.0.0.1 --port 8000 --reload
   

6. Done!: Navigate to http://localhost:8000 in your browser and get started!

Running the Application Again in the Future

1. Start the Application:

   cd backend
   uvicorn main:app --host 0.0.0.0 --port 8000
   

2. Navigate to the App:
   Open your browser and go to http://localhost:8000.

Stopping the Application

To stop the application and free up resources, press Ctrl+C in the terminal running the app.

📂 Dataset Format

{"input": "Enter a really long article here...", "output": "Short summary."},
{"input": "Enter the poem topic here...", "output": "Roses are red..."}

🛠 Tech Stack

• transformers + peft (LoRA finetuning)
• bitsandbytes (4-bit quantization)
• React (UI)
• FastAPI (Backend)
• Python (Backend)
• Node.js (Frontend)