Library for dividing the Embedding layer of the LLM.
Project description
[Currently in development!]
Embeddings-Division
Python script for dividing Embedding layer of LLM.
The solution was tested on meta-llama/Llama-3.2-1B.
Installation
Installation from PyPI:
pip install embdiv
Requirements
- Python 3.9+
- cachetools>=5.5.0,
- torch>=2.5.1,
- transformers>=4.45.2,
Docs
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
embdiv-0.1.0.tar.gz
(7.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file embdiv-0.1.0.tar.gz.
File metadata
- Download URL: embdiv-0.1.0.tar.gz
- Upload date:
- Size: 7.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e264a6400dffc31c48b42f481229443a9dc38ff1d5246f96fda028d2cc3ef9b3
|
|
| MD5 |
fbf3bd6676040362832da3c2144d1c67
|
|
| BLAKE2b-256 |
f45e11145a523b5696d785f04926283a5b9c7dcff314fe6558cab6189d8b4475
|
File details
Details for the file embdiv-0.1.0-py3-none-any.whl.
File metadata
- Download URL: embdiv-0.1.0-py3-none-any.whl
- Upload date:
- Size: 8.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2827a1c04ae22261aca717b13eb6f704210dcd70f8efdad98b4aee2efc2e6e3b
|
|
| MD5 |
02460d9a59d61a541344de2e42d8d904
|
|
| BLAKE2b-256 |
9bd2174925fea0b54da69cb386f2789e185cbc5366fc3c2cf098c6c7823feed2
|
