LlamaIndex Llms Integration: Lmstudio

pip install llama-index-llms-lmstudio

Usage Steps

Open LM Studio App and go to the Local Server Tab
In the Configuration settings, enable Apply Prompt Formatting
Load the model of your choice
Start your server

from llama_index.llms.lmstudio import LMStudio

llm = LMStudio(
    model_name="Hermes-2-Pro-Llama-3-8B",
    base_url="http://localhost:1234/v1",
    temperature=0.7,
)

messages = [
    ChatMessage(
        role=MessageRole.SYSTEM,
        content="You an expert AI assistant. Help User with their queries.",
    ),
    ChatMessage(
        role=MessageRole.USER,
        content="What is the significance of the number 42?",
    ),
]

response = llm.chat(messages=messages)
print(str(response))

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llama_index_llms_lmstudio-0.6.0.tar.gz (5.2 kB view details)

Uploaded Aug 31, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

llama_index_llms_lmstudio-0.6.0-py3-none-any.whl (4.7 kB view details)

Uploaded Aug 31, 2026 Python 3

File details

Details for the file llama_index_llms_lmstudio-0.6.0.tar.gz.

File metadata

Download URL: llama_index_llms_lmstudio-0.6.0.tar.gz
Upload date: Aug 31, 2026
Size: 5.2 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for llama_index_llms_lmstudio-0.6.0.tar.gz
Algorithm	Hash digest
SHA256	`843aae873de090a8f58daa5b49fbb6bc618a63d4950fc813a80a2dc324fb4bab`
MD5	`2bb803b36e410ee087630dcb931e110c`
BLAKE2b-256	`1cd48d623eeb0cd71a430910f5a89d6fa9ca688e3df29f2587a5bd9ddd00c0f7`

See more details on using hashes here.

File details

Details for the file llama_index_llms_lmstudio-0.6.0-py3-none-any.whl.

File metadata

Download URL: llama_index_llms_lmstudio-0.6.0-py3-none-any.whl
Upload date: Aug 31, 2026
Size: 4.7 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for llama_index_llms_lmstudio-0.6.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`047d559b54e80f1c8c0d6e987380880c1fec54ae26e6453dceca29ac1d64bb13`
MD5	`d513980e68ec745f1e4436252b722e22`
BLAKE2b-256	`fcd22888545777ed1273550cea643704f8faa3edceb0c6734f1320beaf99fde4`