Skip to main content

Optimized version of llama3 / gemma.

Project description

llaminate

Optimized version of llama3, using tokun.

This project is a showcase for a new tokenization technique. It uses a NN model to compress the whole Unicode space into tokens.

Resources

Models

Notebooks

TODO

See TODO.

Credits

This project winks at llama3 from Meta, but doesn't actually its weights nor code.

License

Licensed under the aGPLv3.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llaminate-0.0.6.tar.gz (3.1 kB view hashes)

Uploaded Source

Built Distribution

llaminate-0.0.6-py3-none-any.whl (4.7 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page