Skip to main content

Deploy SentenceTransformers embedding models to a ray cluster

Project description

ray-embedding

A tool for deploying SentenceTransformers models to a ray cluster.

Supports the following backends

  • pytorch-gpu
  • pytorch-cpu

Planned:

  • onnx-gpu
  • onnx-cpu
  • openvino-cpu
  • fastembed-onnx-cpu

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ray_embedding-0.9.10.tar.gz (4.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ray_embedding-0.9.10-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file ray_embedding-0.9.10.tar.gz.

File metadata

  • Download URL: ray_embedding-0.9.10.tar.gz
  • Upload date:
  • Size: 4.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ray_embedding-0.9.10.tar.gz
Algorithm Hash digest
SHA256 77cfb25621eb6fa0728ad2c1f90ce59d0e0da4db45f4c82e8363a25ef2ff0e02
MD5 b2080a715dc8f8526b8ebf36a77c166e
BLAKE2b-256 e0d09ae66f7c5e17177dcacd894344ed1446aa443232a3f960c6a19187d34b2f

See more details on using hashes here.

File details

Details for the file ray_embedding-0.9.10-py3-none-any.whl.

File metadata

  • Download URL: ray_embedding-0.9.10-py3-none-any.whl
  • Upload date:
  • Size: 4.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for ray_embedding-0.9.10-py3-none-any.whl
Algorithm Hash digest
SHA256 3281e120f2a988a790adb8a60a87fbb69a9fd33ff40361192310970574878c20
MD5 4d936b2260e065489333cd7d05efb340
BLAKE2b-256 bf6224cb6bc9e81ec0a738234222d613fc744cba362a4de4d84415fb3ee70210

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page