Rotary Positional Embedding (RoPE) for PyTorch
Project description
RoPE Embedding
Minimal PyTorch implementation of Rotary Positional Embeddings (RoPE), used in GPT, LLaMA, and modern LLMs.
Install
pip install rope-embedding
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
rope_pos-0.1.0.tar.gz
(1.1 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file rope_pos-0.1.0.tar.gz.
File metadata
- Download URL: rope_pos-0.1.0.tar.gz
- Upload date:
- Size: 1.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b99426911a01dad57b6c0e216513582e2f1c5e8be27763d7ed3955b62406a899
|
|
| MD5 |
25e95bacba3719c643f7b644ad980619
|
|
| BLAKE2b-256 |
bad43365d377f40bd5ab721c5a4af16c90c977d76ef3d9be86f6ddd97694b4fd
|
File details
Details for the file rope_pos-0.1.0-py3-none-any.whl.
File metadata
- Download URL: rope_pos-0.1.0-py3-none-any.whl
- Upload date:
- Size: 1.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6ce4c3dff2dd7a22c2546bcc15aa8d77d911bd5b226f5ef4f66febe578a4cd7f
|
|
| MD5 |
e31f73a7393cf7289316fb756b9bb389
|
|
| BLAKE2b-256 |
5fdf4944a067356f9485dedfef6c835daff40fb78677fabdbe52f6035f6495e0
|
