Project description

MGQA

The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints"

Paper Link

Appreciation

Lucidrains
Agorians

Install

Usage

Architecture

Todo

License

MIT

Citations

Project details

These details have not been verified by PyPI

Project links

GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Release history Release notifications | RSS feed

0.0.5

Sep 28, 2023

0.0.4

Sep 28, 2023

0.0.3

Sep 27, 2023

This version

0.0.2

Sep 27, 2023

0.0.1

Sep 27, 2023

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mgqa-0.0.2.tar.gz (18.0 kB view hashes)

Uploaded Sep 27, 2023 Source

Built Distribution

mgqa-0.0.2-py3-none-any.whl (18.3 kB view hashes)

Uploaded Sep 27, 2023 Python 3

Hashes for mgqa-0.0.2.tar.gz

Hashes for mgqa-0.0.2.tar.gz
Algorithm	Hash digest
SHA256	`1334f340be8eb703e9d85f7aea145ee4510e13206fea51724d64235f460756b9`
MD5	`e94ef843fddf4b2feff4d458bd990901`
BLAKE2b-256	`97e224864f099193ba242ee1bbd4105125bc51be4566103220bdb1b77d32f485`

Hashes for mgqa-0.0.2-py3-none-any.whl

Hashes for mgqa-0.0.2-py3-none-any.whl
Algorithm	Hash digest
SHA256	`ca73201ec1668630087b615d406450ff02e91278b98b5ab500be4964d8fd93b8`
MD5	`2a1f3b6b1f1e2c6773edd92dbb887a43`
BLAKE2b-256	`0b85d5d076b66a7c0a09762c98b3fd48c5a6726535d3cb2d36801b30b4eaaa82`