Skip to main content

llama-index-llms-turing

LlamaIndex LLM for Turing Engine. Turing is LlamaIndex's OpenAILike client with Turing's defaults: chat endpoint, tool calling on, api_base from $TURING_API_BASE (else http://localhost:8000/v1) and api_key from $TURING_API_KEY (checked only when the server runs with --api-key). It does not depend on Turing Engine itself.

pip install llama-index-llms-turing   # not on PyPI yet: pip install ./packages/llama-index-llms-turing from a clone of intutic/turing
turing serve --model Qwen/Qwen2.5-1.5B-Instruct --port 8000   # on the machine with the GPU
from llama_index.core.llms import ChatMessage
from llama_index.llms.turing import Turing

llm = Turing(model="Qwen/Qwen2.5-1.5B-Instruct", context_window=32768, max_tokens=256)

print(llm.complete("Explain KV cache paging in one sentence:"))
print(llm.chat([ChatMessage(role="user", content="Write a haiku about GPUs")]))
for chunk in llm.stream_complete("Count to five:"):
    print(chunk.delta, end="", flush=True)

Set context_window to the served model's; LlamaIndex uses it to size prompts. Tool calling (FunctionAgent, llm.predict_and_call) goes through the server's OpenAI tools API; whether the model calls a tool depends on the model.

Tests

pip install -e ".[test]"
TURING_API_BASE=http://localhost:8000/v1 TURING_MODEL=Qwen/Qwen2.5-1.5B-Instruct pytest tests

License: Apache-2.0 (Turing Engine itself is BSL 1.1).

Metadata

Release files for llama-index-llms-turing 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llama-index-llms-turing 0.1.0
File Size Uploaded Provenance Actions
llama_index_llms_turing-0.1.0.tar.gz 7.7 kB With provenance Details for llama_index_llms_turing-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for llama-index-llms-turing 0.1.0
File Interpreter ABI Platform Actions
llama_index_llms_turing-0.1.0-py3-none-any.whl Python 3 none any Details for llama_index_llms_turing-0.1.0-py3-none-any.whl

Total release size: 15.1 kB

Release files / llama_index_llms_turing-0.1.0.tar.gz

Download URL llama_index_llms_turing-0.1.0.tar.gz
Size 7.7 kB
Tags Source
SHA-256 checksum
How to use checksums
1f6480455062915e3275735258344856164da98d896ecbc91f9d96cd5d47569f
BLAKE2b-256 checksum
How to use checksums
0fc3fb85605bfc09059e88d0f88050f03d0cbadcfceebff0bb2356a16b9bd797
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 20, 2026.

Transparency log

Release files / llama_index_llms_turing-0.1.0-py3-none-any.whl

Download URL llama_index_llms_turing-0.1.0-py3-none-any.whl
Size 7.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e2c38e84ea2d408a46e4b7d7a195be6895c41363afc15c9b586880445b920c2c
BLAKE2b-256 checksum
How to use checksums
5daa9c3fb561f8fda8184239f9092cdee187ca901f23fa0c5f48287acbe10e60
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.16

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 20, 2026.

Transparency log

Security for llama-index-llms-turing 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for llama_index_llms_turing-0.1.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Nov 20, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page