Skip to main content

Multi-Modality

GPT4o

Community Open Source Implementation of GPT4o in PyTorch

Install

Architecture

  • TikToken Tokenzier: We know fursure the tokenizer. Which is here
  • Model understands Images and Audio Natively. There are 2 approaches, process them natively or use encoders for each. I think here they're using encoders like whisper and vit for simplicity and brevity.
  • Using DALLE3 as the output head to generate images
  • Tokens to denote when to generate an image or audio
  • Whisper output head for the audio outputs

License

MIT

Release files for gpt4o 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for gpt4o 0.0.1
File Size Uploaded
gpt4o-0.0.1.tar.gz 3.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for gpt4o 0.0.1
File Interpreter ABI Platform
gpt4o-0.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 6.1 kB

Release files / gpt4o-0.0.1.tar.gz

Download URL gpt4o-0.0.1.tar.gz
Size 3.1 kB
Tags Source
SHA-256 checksum
How to use checksums
54fb69e976de3d0cee675098d1ca3e2c0f254eaec5405354d0cb14f425ddcbed
BLAKE2b-256 checksum
How to use checksums
695d8423537f2ee1002c75f4150881f4290966f33d94dcca67bc82a3ecbc763f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/23.3.0

Release files / gpt4o-0.0.1-py3-none-any.whl

Download URL gpt4o-0.0.1-py3-none-any.whl
Size 3.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
39467fd746688ec553d1740be9ffce1eacdd6b0678ebfecec1ec1f17c7c2faa4
BLAKE2b-256 checksum
How to use checksums
1a027e8b342cd05e28f3a689b712c08fd632781b3d6447cf843b9b3841526d9b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.3.2 CPython/3.11.0 Darwin/23.3.0

Release history Release notifications | RSS feed

This release

0.0.1 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page