Skip to main content

VLLM adapters for Bridgic, enabling connectivity with self-hosted LLM providers.

Project description

Bridgic LLMs Integration

This package integrates vLLM model services into the Bridgic framework, providing common calling interfaces for self-hosted LLM service, such as chat, stream, as well as with encapsulation of common seen high-level functionality.

Installation

pip install bridgic-llms-vllm

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bridgic_llms_vllm-0.1.0rc1.tar.gz (4.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bridgic_llms_vllm-0.1.0rc1-py3-none-any.whl (5.8 kB view details)

Uploaded Python 3

File details

Details for the file bridgic_llms_vllm-0.1.0rc1.tar.gz.

File metadata

File hashes

Hashes for bridgic_llms_vllm-0.1.0rc1.tar.gz
Algorithm Hash digest
SHA256 4608b5cb7bd4e4b41f676c29f58467b3afec030a841ecf3739aaf37e91bb67a6
MD5 c10968a7e96f1f6b8e1efd577429d073
BLAKE2b-256 9203b70925e5877ac99ec74270d85af61dbf4ffc4cd0b1bc79a4bf4c0f86a0ab

See more details on using hashes here.

File details

Details for the file bridgic_llms_vllm-0.1.0rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for bridgic_llms_vllm-0.1.0rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 795bb6f3a23c6ae19e98d04a1df0c159934107877c7adc6635cb1252608894fe
MD5 910b44a1c139a0488a87cd614c23684e
BLAKE2b-256 c84ed74035427b476cea4cefaf98c955d3ee120f44f5bd1a43c2d39454d41c7d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page