Utils for Unsloth
Project description
Unsloth Zoo - Utils for Unsloth!
✨ Finetune for Free
All notebooks are beginner friendly! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model which can be exported to GGUF, Ollama, vLLM or uploaded to Hugging Face.
| Unsloth supports | Free Notebooks | Performance | Memory use |
|---|---|---|---|
| Llama 3.2 (3B) | ▶️ Start for free | 2x faster | 60% less |
| Llama 3.1 (8B) | ▶️ Start for free | 2x faster | 60% less |
| Phi-3.5 (mini) | ▶️ Start for free | 2x faster | 50% less |
| Gemma 2 (9B) | ▶️ Start for free | 2x faster | 63% less |
| Mistral Small (22B) | ▶️ Start for free | 2x faster | 60% less |
| Ollama | ▶️ Start for free | 1.9x faster | 43% less |
| Mistral v0.3 (7B) | ▶️ Start for free | 2.2x faster | 73% less |
| ORPO | ▶️ Start for free | 1.9x faster | 43% less |
| DPO Zephyr | ▶️ Start for free | 1.9x faster | 43% less |
- Kaggle Notebooks for Llama 3.1 (8B), Gemma 2 (9B), Mistral (7B)
- Run Llama 3.2 1B 3B notebook and Llama 3.2 conversational notebook
- Run Llama 3.1 conversational notebook and Mistral v0.3 ChatML
- This text completion notebook is for continued pretraining / raw text
- This continued pretraining notebook is for learning another language
- Click here for detailed documentation for Unsloth.
🔗 Links and Resources
| Type | Links |
|---|---|
| 📚 Documentation & Wiki | Read Our Docs |
 Twitter (aka X) |
Follow us on X |
| 💾 Installation | unsloth/README.md |
| 🥇 Benchmarking | Performance Tables |
| 🌐 Released Models | Unsloth Releases |
| ✍️ Blog | Read our Blogs |
⭐ Key Features
- All kernels written in OpenAI's Triton language. Manual backprop engine.
- 0% loss in accuracy - no approximation methods - all exact.
- No change of hardware. Supports NVIDIA GPUs since 2018+. Minimum CUDA Capability 7.0 (V100, T4, Titan V, RTX 20, 30, 40x, A100, H100, L40 etc) Check your GPU! GTX 1070, 1080 works, but is slow.
- Works on Linux and Windows via WSL.
- Supports 4bit and 16bit QLoRA / LoRA finetuning via bitsandbytes.
- Open source trains 5x faster - see Unsloth Pro for up to 30x faster training!
- If you trained a model with 🦥Unsloth, you can use this cool sticker!
💾 Installation Instructions
These are utilities for Unsloth, so install Unsloth as well! For stable releases for Unsloth Zoo, use pip install unsloth_zoo. We recommend pip install "unsloth_zoo @ git+https://github.com/unslothai/unsloth-zoo.git" for most installations though.
pip install unsloth_zoo
License
Unsloth Zoo is licensed under the GNU Affero General Public License.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file unsloth_zoo-2024.11.8.tar.gz.
File metadata
- Download URL: unsloth_zoo-2024.11.8.tar.gz
- Upload date:
- Size: 52.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
75e762877587b2628e58b4b28a0f985804c97be784c720fff3406ef03b44f5db
|
|
| MD5 |
cb2a06aee482a48cb953e084e81e872c
|
|
| BLAKE2b-256 |
a44d0911f84461016a919b23c9185dd3b144b062a442b06e9d7b4cf2013e576a
|
File details
Details for the file unsloth_zoo-2024.11.8-py3-none-any.whl.
File metadata
- Download URL: unsloth_zoo-2024.11.8-py3-none-any.whl
- Upload date:
- Size: 59.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
53443b8791c5b9b2f1a22de33372ae4e483d72b86b0429876db27c62817e6029
|
|
| MD5 |
4422c40b0ad23c20af77b83e0be00ce3
|
|
| BLAKE2b-256 |
bba7b142491c673140d1d62c28d4720d85b94d9577d7d6fb8534a4e6bb5e1909
|
