llm-smollm2 0.1

SmolLM2-135M-Instruct.Q4_1 for LLM

llm-smollm2

SmolLM2-135M-Instruct.Q4_1 for LLM

Installation

Install this plugin in the same environment as LLM.

llm install llm-smollm2

Usage

This plugin bundles a full copy of the SmolLM2-135M-Instruct.Q4_1 quantized version of the SmolLM2-135M-Instruct model by HuggingFaceTB.

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-smollm2
python -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

python -m pytest