Optimized version of llama3 / gemma.

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for apehex from gravatar.com apehex

Unverified details

These details have not been verified by PyPI
Meta
  • Author: apehex
  • Requires: Python <3.12, >=3.10
Classifiers

Project description

llaminate

Optimized version of llama3, using tokun.

Neural tokenization

This project is a showcase for a neural tokenization technique. Since the inputs are compressed and have a smaller shape, the LLM is downsized accordingly.

For example, llama3-8b is brought down to 34 million parameters instead of 8 billion.

Installation

Usage

Resources

Models

Notebooks

Final model:

TODO

See TODO.

Credits

This project winks at llama3 from Meta, but doesn't actually its weights nor code.

License

Licensed under the aGPLv3.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for apehex from gravatar.com apehex

Unverified details

These details have not been verified by PyPI
Meta
  • Author: apehex
  • Requires: Python <3.12, >=3.10
Classifiers

Release history Release notifications | RSS feed

0.6.6

0.6.5

0.6.4

0.6.3

0.6.2

0.6.1

0.6.0

0.5.8a0 pre-release

0.5.6

0.5.5

0.5.4

0.5.3

0.5.2

0.5.1

This version

0.4.1

0.4.0

0.3.10

0.3.8

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.2

0.2.1

0.2.0

0.1.4

0.1.3

0.1.2

0.1.0

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llaminate-0.4.1.tar.gz (4.4 kB view hashes)

Uploaded Source

Built Distribution

llaminate-0.4.1-py3-none-any.whl (6.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page