Skip to main content

A structured response wrapper for LLMs using Pydantic.

Project description

llmschema

PyPI

llmschema is a Python library that ensures structured and validated responses from LLMs (Large Language Models) like Ollama, OpenAI, and Gemini by enforcing user-defined Pydantic schemas. It abstracts model-specific quirks and guarantees responses in a safe, predictable, and JSON-compliant format.

🚀 Features

Enforces Pydantic schema on LLM responses
Works with multiple LLM providers (Ollama, OpenAI, Gemini, etc.)
Handles malformed JSON responses gracefully
Easy integration into existing applications
Modular & scalable design


📦 Installation

Install llmschema via pip:

pip install llmschema

🛠 Usage

1️⃣ Define a Schema

from pydantic import BaseModel
from llmschema import SchemaManager, generate_response

class MyResponseSchema(BaseModel):
    text: str
    confidence: float

SchemaManager.set_schema(MyResponseSchema)

2️⃣ Generate a Response from an LLM

response = generate_response("mistral", "Summarize the latest AI news")
print(response)  # Output will follow MyResponseSchema format

3️⃣ Handling Errors

from llmschema import LLMValidationError

try:
    response = generate_response("gemini", "Give me a JSON response")
except LLMValidationError as e:
    print("Invalid response:", e)

⚙️ Supported LLMs

llmschema is designed to work with different LLM providers:

  • Ollama (Mistral, Llama, etc.)
  • OpenAI (GPT models)
  • Gemini (Google's LLM)

More integrations coming soon!


✅ Handling Non-JSON Responses

If an LLM outputs invalid JSON, llmschema will:

  1. Try to extract JSON using regex.
  2. Log warnings for malformed responses.
  3. Raise an error if parsing fails completely.

🧪 Running Tests

To test the library locally:

pytest tests/

📜 License

This project is licensed under the MIT License.


🤝 Contributing

Contributions are welcome! Feel free to submit issues and PRs on GitHub.

GitHub Repo: https://github.com/yourusername/llmschema

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmschema-0.2.0.tar.gz (5.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llmschema-0.2.0-py3-none-any.whl (5.7 kB view details)

Uploaded Python 3

File details

Details for the file llmschema-0.2.0.tar.gz.

File metadata

  • Download URL: llmschema-0.2.0.tar.gz
  • Upload date:
  • Size: 5.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for llmschema-0.2.0.tar.gz
Algorithm Hash digest
SHA256 90bc6df7995d101b9a3cb73da5f75777f69f199ed302f0a902180a36f7cf31f5
MD5 5c5e5b4aad486660f365313a1e2d8935
BLAKE2b-256 98c0b74213f890380771884aa06fc1241b4c04fa3ff99de38644b0269d3f0cb0

See more details on using hashes here.

File details

Details for the file llmschema-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: llmschema-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 5.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for llmschema-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 899ca0c0b1a65272d680ed7123ae0fbf9a6029c1bd7686c58028b9d42d3cf9fc
MD5 cfea254bd757d8e7c67dbaa547f6e223
BLAKE2b-256 dcca9c631bb16a3076e8aa0aeb7bb6fa599c5cc88b124270a58cb423e29ebdbc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page