Skip to main content

lfx-vllm

vLLM as a first-class Langflow model provider, packaged as a standalone Extension Bundle.

Registers a vLLM model provider that appears in Langflow's unified model picker alongside the built-in providers. vLLM serves an OpenAI-compatible HTTP API, so the provider reuses the ChatOpenAI / OpenAIEmbeddings classes and discovers the served models live from the server's /v1/models endpoint — the same model is therefore offered in both the Language Model and Embedding Model contexts.

Unlike a component bundle, this ships no component: it contributes a provider through the providers[] block in extension.json, which Langflow's provider registry merges into the unified model system. It edits no Langflow core files.

Configure

Set the vLLM endpoint (and, if your server requires it, an API key) under Settings → Model Providers → vLLM, or via environment variables:

  • VLLM_API_BASE — base URL of your vLLM server, e.g. http://localhost:8000 (required).
  • VLLM_API_KEY — bearer token, if your server enforces one (optional; servers without auth do not need it).

Install

pip install lfx-vllm

The bundle is registered automatically via the langflow.extensions entry-point. Restart your Langflow server and select vLLM in any Language Model or Embedding Model field.

Develop

cd src/bundles/vllm
pip install -e .
lfx extension validate src/lfx_vllm

Credit

Inherits the original vLLM provider contributed in #13910 by Yash Pareek (@pareek-ml). This bundle reconstructs that work on the provider-registry extension point so it ships without editing Langflow core.

Metadata

Release files for lfx-vllm 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for lfx-vllm 0.2.1
File Interpreter ABI Platform Actions
lfx_vllm-0.2.1-py3-none-any.whl Python 3 none any Details for lfx_vllm-0.2.1-py3-none-any.whl

Release files / lfx_vllm-0.2.1-py3-none-any.whl

Download URL lfx_vllm-0.2.1-py3-none-any.whl
Size 5.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
600fac6ad9676308a0fa823a1b1d12817ebf5451b230bb6aed105689fd4f0d47
BLAKE2b-256 checksum
How to use checksums
28ee849ffd5760ef586bf10376e5f529b815eef4f00c108cdab6fb6c2d751686
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.3 {"installer":{"name":"uv","version":"0.12.3","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for lfx-vllm 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page