Unofficial codebase for the "Retentive Network: A Successor to Transformer for Large Language Models" paper [https://arxiv.org/pdf/2307.08621.pdf]

These details have not been verified by PyPI

Project description

RetentiveNetwork

Unofficial codebase for the "Retentive Network: A Successor to Transformer for Large Language Models" paper [https://arxiv.org/pdf/2307.08621.pdf]

The official codebase for RetNet should be made available roughly August 1st, 2023 according to Microsoft here:

These details have not been verified by PyPI

0.1.0

Jul 23, 2023

This version

0.0.1

Jul 21, 2023

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Jul 21, 2023 Source

Uploaded Jul 21, 2023 Python 3

Hashes for retentive_network-0.0.1.tar.gz
Algorithm	Hash digest
SHA256	`fedfdfef80bc92c245fecf1dc67f58d4dd3e49e220f663cfe5f312d9b321f997`
MD5	`ea8a18a084180595d3b9fc5a168742c6`
BLAKE2b-256	`6cfb217ba72ea26f441290666a29387db265a30d81b6f7533622f575e549c0e5`

Hashes for retentive_network-0.0.1-py3-none-any.whl
Algorithm	Hash digest
SHA256	`0a9b6b80c4f8ef16dffba0adfa20c744d99f8f9d8de3b9f8c3f4e3c34e0b40c7`
MD5	`5f4a800c8d6924b95cf058104c9ba2e5`
BLAKE2b-256	`7ec709dba9ceb12d7e07af86f08b5b3533cdd01a4b4e5c2008db01f750a38378`