Skip to main content

CAMEL: Context-Aware Modifier for Efficient Language model

Project description

CAMEL

Introduction

CAMEL(Context-Aware Modifier for Efficient Language model) is a speculative decoding method inspired by EAGLE. It compresses former input hidden states of window size.

architecture

Usage

Reference

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

modifier-0.0.2.tar.gz (36.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

modifier-0.0.2-py3-none-any.whl (40.0 kB view details)

Uploaded Python 3

File details

Details for the file modifier-0.0.2.tar.gz.

File metadata

  • Download URL: modifier-0.0.2.tar.gz
  • Upload date:
  • Size: 36.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.11.3 Linux/6.5.0-35-generic

File hashes

Hashes for modifier-0.0.2.tar.gz
Algorithm Hash digest
SHA256 cab2dd205e4f7c7e4413eb1f126e48d054bae70998b192d9b3165422c98a57bb
MD5 ee11b47744644d8e67fea76adeef9805
BLAKE2b-256 4ab13ad0d41ecb88121abdfb821553f4c2852f99bc13042fb3ba2165fbd57bd0

See more details on using hashes here.

File details

Details for the file modifier-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: modifier-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 40.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.11.3 Linux/6.5.0-35-generic

File hashes

Hashes for modifier-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 c90139a676e6f6557d15273c9ebcf4e9fac10a88ce4ed87734aff3d5d152c2b7
MD5 cdc776cce9e8e4fc9dda2e4c63114d0a
BLAKE2b-256 2d6a70f384f55bd892f45bcc88b7a7259f5b752098cbdbd54acc4d78f5918eec

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page