langchain-llama-server

This LangChain integration supports llama-server for remote inference over HTTP/S.

Normally you can use ChatOpenAI from langchain-openai for OpenAI compatible APIs. But, anything beyond the OpenAI spec is not supported. Hence why this integration exists.

This package was created to fill in the gaps between the OpenAI spec and extra fields llama-server returns:

Access reasoning_content on both streaming and non-streaming chat completions.
Capture timings, __verbose and other llama-server specific response fields.
Uses BaseChatOpenAI from langchain-openai to implement a chat_model called ChatLlamaServer

Similar to other server integrations:

ChatOllama
ChatXAI
- ChatXAI also works with llama-server for reasoning_content because they both implement the OpenAI spec closely
ChatOpenRouter

TODO

LlamaServerLLM ?
LlamaServerEmbedding ?
/slots endpoint -- introspect concurrent-request/context-slot usage
n_probs/logprobs support

What about ChatLlamaCpp?

The langchain_community package provides ChatLlamaCpp? This chat model targets in-process hosting using llama.cpp. It doesn't support llama-server for remote hosting.

Metadata

Release files for langchain-llama-server 0.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for langchain-llama-server 0.2.0
File	Size	Uploaded	Provenance
langchain_llama_server-0.2.0.tar.gz	136.7 kB	Jul 27, 2026	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for langchain-llama-server 0.2.0
File	Interpreter	ABI	Platform	Reset
langchain_llama_server-0.2.0-py3-none-any.whl 5.5 kB Jul 27, 2026 Without provenance	Python 3	none	any	Details

Total release size: 142.2 kB

Release files / langchain_llama_server-0.2.0.tar.gz

Download URL	langchain_llama_server-0.2.0.tar.gz
Size	136.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`5856b3591db43bf4c7186add8fb37a18d3b8d93127811f1a500739a355508aa4`
BLAKE2b-256 checksum How to use checksums	`ac1ac09e77e8ed3e8ee08ed84fe96aae3662745a01a75f5b9b61ee9358948260`
Upload date	Jul 27, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Release files / langchain_llama_server-0.2.0-py3-none-any.whl

Download URL	langchain_llama_server-0.2.0-py3-none-any.whl
Size	5.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`7a3fbc6578a654a2e531109b36ce1f8cd303e4a845828f2464f8f1537b0faf6b`
BLAKE2b-256 checksum How to use checksums	`767819b6999c9803d3387868ee0cf518ace27bd3ed09ad6dc9805aefcd21e821`
Upload date	Jul 27, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}`

Security for langchain-llama-server 0.2.0

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.