A minimal PyTorch implementation of LoRA
Project description
Pytora
A minimal pytorch implementation for lora via pytorch parametrizations
Installation
pip install pytora
Usage
from pytora import apply_lora
apply_lora(
model,
lora_r = 4,
lora_alpha = 1,
lora_dropout = 0.0
)
A simple example use case with a pretrained huggingface model can be found in demo.ipynb
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pytora-0.0.4.tar.gz
(2.9 kB
view hashes)
Built Distribution
pytora-0.0.4-py3-none-any.whl
(3.4 kB
view hashes)