Skip to main content

Zero-Training Context Extension for Transformer Encoders via Nonlinear Absolute Positional Embeddings Interpolation

Reason this release was yanked:

Unaccessible scripts

Project description

Zero-Training Context Extension for Transformer Encoders via Nonlinear Absolute Positional Embeddings Interpolation

Official implementation of "Zero-Training Context Extension for Transformer Encoders via Nonlinear Absolute Positional Embeddings Interpolation". Paper preprint is coming soon.

Models

Models are available at HuggingFace:

Model Context length Language
idanylenko/e5-large-v2-ctx1024 1024 English

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

context_extension-0.1.0.tar.gz (8.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

context_extension-0.1.0-py3-none-any.whl (11.6 kB view details)

Uploaded Python 3

File details

Details for the file context_extension-0.1.0.tar.gz.

File metadata

  • Download URL: context_extension-0.1.0.tar.gz
  • Upload date:
  • Size: 8.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for context_extension-0.1.0.tar.gz
Algorithm Hash digest
SHA256 70e8af787a890503d33f068a69ab8cd4c4d2baa853161cdd688b4830668035a2
MD5 98152b37bfb6ced39e3f16dfb9ad5349
BLAKE2b-256 05c2a074c3af371caf322a109891e70a9abd585d3a9b32dc447767827a305c84

See more details on using hashes here.

Provenance

The following attestation bundles were made for context_extension-0.1.0.tar.gz:

Publisher: python-publish.yml on Kowd-PauUh/encoders-context-extension

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file context_extension-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for context_extension-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a365660d21bf94a8acf0a591f24df6ed6211ccccf3828dcfdcf806db74076712
MD5 ee27d85afabc706a7636a1199842de84
BLAKE2b-256 d86d39d5fa37007457f8cec3637fe6e59d52a50758886c01d44eff4f201d97cc

See more details on using hashes here.

Provenance

The following attestation bundles were made for context_extension-0.1.0-py3-none-any.whl:

Publisher: python-publish.yml on Kowd-PauUh/encoders-context-extension

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page