An open, more reliable architecture for parsing LLM output.
Project description
Phoenix: A Resilient Semantic Parser for LLM Output
Getting reliable structured data from Large Language Models (LLMs) is a fundamental engineering challenge. When an LLM's output deviates even slightly from a strict JSON format, traditional parsers fail.
Phoenix is a lightweight, dependency-free library that intelligently extracts structured data from messy or incomplete LLM outputs. It doesn't just follow rules—it understands and recovers.
Key Features
- Resilience Cascade: A three-layer defense system to ensure you always get a result.
- Intelligent Cleaning: Automatically handles common LLM errors like comments, trailing commas, and "smart" quotes.
- Semantic Recovery: As a last resort, it scans unstructured text to find key-value pairs and rebuilds the data from scratch.
- Pydantic Integration: Leverages Pydantic for robust validation of the final output.
- Lightweight & Fast: Zero dependencies besides Pydantic, ensuring easy integration.
How It Works: The Resilience Cascade
Phoenix processes LLM output through three layers of defense:
- Markdown Search: It first looks for JSON inside standard
json ...code blocks. - Direct Parsing & Cleaning: It then attempts to parse the output as clean JSON, automatically removing common syntax errors like comments.
- Semantic Extraction: If all else fails, Phoenix activates its superpower: it analyzes the raw, unstructured text, finds
key: valuepairs, and reconstructs the data.
Installation
pip install phoenix-parser
Quickstart
Here's how to use Phoenix to reliably parse data from a messy LLM output.
from phoenix_parser import AdaptiveSemanticParser, ParsingError
from pydantic import BaseModel, Field
# 1. Define your desired data structure using Pydantic
class UserProfile(BaseModel):
user_name: str = Field(description="The full name of the user.")
user_id: int = Field(description="The unique user identifier.")
is_active: bool = Field(description="The active status of the user account.")
# 2. Get a messy, real-world output from an LLM
messy_llm_output = """
Here are the user details you requested.
// User is confirmed active.
```json
{
“user_name”: “Alice”,
“user_id”: "123", // ID is a string, needs to be an int!
“is_active”: true, // Trailing comma...
}
Let me know if you need anything else! """
3. Create a parser instance and parse the data
parser = AdaptiveSemanticParser()
try: # Phoenix will automatically clean, parse, and validate the data validated_data = parser.parse(messy_llm_output, UserProfile)
print("✅ Successfully parsed and validated!")
print(validated_data)
# Output: {'user_name': 'Alice', 'user_id': 123, 'is_active': True}
assert isinstance(validated_data['user_id'], int)
except ParsingError as e: print(f"❌ Failed to parse data: {e}")
---
## Comparison with Classic Parsers
| Feature | Classic Parsers (e.g., `json.loads`) | The Phoenix Parser |
|-----------------------|-----------------------------------------------------------|----------------------------------------------------------|
| **Technology** | Rigid grammars | Hybrid: Direct parsing + Semantic understanding |
| **Flexibility** | Low (breaks on syntax errors) | High (handles messy structures, comments, etc.) |
| **Failure Response** | Hard `JSONDecodeError` | Semantic data recovery |
| **Paradigm** | "Fixing chaos with rules." | "Using intelligence to understand chaos." |
---
## License
This project is licensed under the Apache 2.0 License. See the [LICENSE](LICENSE) file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file phoenix_parser-0.5.2.tar.gz.
File metadata
- Download URL: phoenix_parser-0.5.2.tar.gz
- Upload date:
- Size: 10.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
18893573d0dc5ef8e8d3d8dfd94126bb3f1fb6feb2f2094f8a00188e358bdf7c
|
|
| MD5 |
5754278817ec63e6e45810a32046211e
|
|
| BLAKE2b-256 |
b582272b9b2b38cc61946f32e2b0fa5c2c4f51b3522a4d96183e60a3719d8309
|
File details
Details for the file phoenix_parser-0.5.2-py3-none-any.whl.
File metadata
- Download URL: phoenix_parser-0.5.2-py3-none-any.whl
- Upload date:
- Size: 13.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
85d90f7227fbb28efda2e8251a43a794cb1707de67e0b7802c32eb9d626caec0
|
|
| MD5 |
50b02a044c39f208f986439e2bc51e4b
|
|
| BLAKE2b-256 |
22475ae810ea67920ed76967f98d7ed35d896acb950d05846c83d607b26c7a1e
|