SillikaLM - Krishnakanth Allika's Silly Language Models

Overview

SillikaLM is a project I created as a fun yet meaningful exploration of language models—its name, a playful twist on "Allika's Silly Language Models." The goal is to dive into LLM technology: setting up and running models locally with Ollama, evaluating small and tiny models from Ollama and Hugging Face, integrating them into a Python-based web UI, and even developing new SillikaLM models for local use.

At its core, SillikaLM is a lightweight platform for managing and deploying language models. Built with FastAPI, it provides functionalities for creating, listing, and deleting models. It leverages Ollama for model management and OpenWebUI for an intuitive web-based interface, making AI experimentation more accessible and seamless.

SillikaLM Models and Their Personalities

Features

SillikaLM allows users to create, list, and delete SillikaLM models with ease. It supports base models from Ollama and Hugging Face, enabling flexible model selection. The platform simplifies model creation based on base model information and includes comprehensive logging for activity and error tracking. Additionally, it features a web-based interface powered by OpenWebUI for a seamless user experience.

Installation

Prerequisites

Python

Ensure you have Python installed on your system. For beginners, using Anaconda to manage Python installations is recommended.

Windows:

1. Download Miniconda from here and install it.

macOS and Linux:

1. Follow the instructions at Anaconda's official documentation.

Alternatively, you can install Python from python.org if you are comfortable managing upgrades and environments.

Ollama

Ollama must me installed on your system. If you haven't installed Ollama, you can do so by following the instructions here.

Running SillikaLM

SillikaLM is tested on Python 3.11 and 3.12. It is recommended to use Python 3.11 for default compatibility. If you are using Python 3.12, you may need to install Visual C++ Build Tools.

With uv (Recommended)

1. Create a new conda environment with Python 3.11:

   conda create -n sillikalm uv python=3.11
   

2. Activate the environment:

   conda activate sillikalm
   

3. Install SillikaLM:

   uv pip install sillikalm
   

4. Run SillikaLM:

   sillikalm
   

With pip

1. Create a new conda environment with Python 3.11:

   conda create -n sillikalm python=3.11
   

2. Activate the environment:

   conda activate sillikalm
   

3. Install SillikaLM:

   pip install sillikalm
   

4. Run SillikaLM:

   sillikalm
   

Web Interface

The SillikaLM web interface, powered by OpenWebUI, provides a user-friendly experience for managing language models. Key features include:

• Model Selection: Choose a base model from the dropdown menu to build SillikaLM models.
• Install Models: Install all SillikaLM models with a single click.
• List Models: Display a list of all installed SillikaLM models.
• Chat: Interact with SillikaLM models through a chat interface.
• Delete Model: Select and delete a specific SillikaLM model.
• Delete all SillikaLMs: Remove all installed SillikaLM models.
• Shutdown: Safely shut down the SillikaLM application.
• Logs: View detailed logs of model activities, including installations, deletions, and interactions.

The interface also displays model details such as name, size, parameters, quantization, and last modified date.

License

This project is licensed under the GNU General Public License v3 (GPLv3). For more details, refer to the LICENSE file.

Contact

For any inquiries or support, please contact Krishnakanth Allika at speed-acorn-whiff [at] duck [dot] com.

This documentation provides a comprehensive guide for end users to understand, install, and use the SillikaLM project. For further details, refer to the source code and comments within the project files.