Tiny GPTV - Pytorch
Project description
TinyGPTV
Simple Implementation of TinyGPTV in super simple Zeta lego blocks. Here all the modules from figure 2 are implemented in Zeta and Pytorch
Install
pip3 install tiny-gptv
Usage
import torch
from tiny_gptv import TinyGPTVBlock
x = torch.rand(2, 8, 512)
lora_mha = TinyGPTVBlock(512, 8)
out = lora_mha(x)
print(out.shape)
Citation
@misc{yuan2023tinygptv,
title={TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones},
author={Zhengqing Yuan and Zhaoxu Li and Lichao Sun},
year={2023},
eprint={2312.16862},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
License
MIT
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tiny_gptv-0.0.3.tar.gz
(3.7 kB
view details)
Built Distribution
File details
Details for the file tiny_gptv-0.0.3.tar.gz.
File metadata
- Download URL: tiny_gptv-0.0.3.tar.gz
- Upload date:
- Size: 3.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5b78fcfe45661530ede2adfc9709ee3bfcaf7e394f239340d02d8e1dfef906a5 |
|
| MD5 | 4ebbd444cc8de613241e6f5037f7b599 |
|
| BLAKE2b-256 | cd54c1de16ab98141d94217320f7de38717a3c9cf2b7521b8de10f0a5add4ea8 |
File details
Details for the file tiny_gptv-0.0.3-py3-none-any.whl.
File metadata
- Download URL: tiny_gptv-0.0.3-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.3.2 CPython/3.11.0 Darwin/22.4.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | ae2b5ab73e63ba5426ea659ffb7048242f2242d663014812deb7f6d5937e479d |
|
| MD5 | ac15077055549a0b67b69784649598d1 |
|
| BLAKE2b-256 | 2a9b3b1fedff20e9c636572fdecff73ef49756a1d03bd0d1e19cd69331eb4284 |
