Skip to main content

A structured response wrapper for LLMs using Pydantic.

Project description

llmschema

llmschema is a Python library that ensures structured and validated responses from LLMs (Large Language Models) like Ollama, OpenAI, and Gemini by enforcing user-defined Pydantic schemas. It abstracts model-specific quirks and guarantees responses in a safe, predictable, and JSON-compliant format.

🚀 Features

Enforces Pydantic schema on LLM responses
Works with multiple LLM providers (Ollama, OpenAI, Gemini, etc.)
Handles malformed JSON responses gracefully
Easy integration into existing applications
Modular & scalable design


📦 Installation

Install llmschema via pip:

pip install llmschema

🛠 Usage

1️⃣ Define a Schema

from pydantic import BaseModel
from llmschema import SchemaManager, generate_response

class MyResponseSchema(BaseModel):
    text: str
    confidence: float

SchemaManager.set_schema(MyResponseSchema)

2️⃣ Generate a Response from an LLM

response = generate_response("mistral", "Summarize the latest AI news")
print(response)  # Output will follow MyResponseSchema format

3️⃣ Handling Errors

from llmschema import LLMValidationError

try:
    response = generate_response("gemini", "Give me a JSON response")
except LLMValidationError as e:
    print("Invalid response:", e)

⚙️ Supported LLMs

llmschema is designed to work with different LLM providers:

  • Ollama (Mistral, Llama, etc.)
  • OpenAI (GPT models)
  • Gemini (Google's LLM)

More integrations coming soon!


✅ Handling Non-JSON Responses

If an LLM outputs invalid JSON, llmschema will:

  1. Try to extract JSON using regex.
  2. Log warnings for malformed responses.
  3. Raise an error if parsing fails completely.

🧪 Running Tests

To test the library locally:

pytest tests/

📜 License

This project is licensed under the MIT License.


🤝 Contributing

Contributions are welcome! Feel free to submit issues and PRs on GitHub.

GitHub Repo: https://github.com/yourusername/llmschema

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmschema-0.1.0.tar.gz (5.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llmschema-0.1.0-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file llmschema-0.1.0.tar.gz.

File metadata

  • Download URL: llmschema-0.1.0.tar.gz
  • Upload date:
  • Size: 5.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for llmschema-0.1.0.tar.gz
Algorithm Hash digest
SHA256 54335775e82d5307cc75635a7b5722b2257b8e0c6fc927b4785ffa53b3715f91
MD5 91aeaddc9e0a44ae28436b9ea7423852
BLAKE2b-256 103daaff007bee84920efaad441de54c027982e73c5bbb2694bf0c4cd5327138

See more details on using hashes here.

File details

Details for the file llmschema-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llmschema-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 4.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for llmschema-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cf1de688f359ab416e71e52035acf0a4d4b006826cace7100ea3ca59e37ebb7a
MD5 b238cd441ff6a92e64b210af86c12dde
BLAKE2b-256 3db6ae79492fe0099e3de3435fbabec08b3cf76d9a84ce96372b2617bf06197c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page