Skip to main content

A type-safe immutable JSON toolkit with chainable method access.

Project description

CrystFlux

Python Version License PyPI Version Immutability JSON Access

CrystFlux is a type-safe immutable JSON toolkit with chainable method access.

Related Documents

Table of Contents

Introduction

CrystFlux is a library. It was born from exploring better approaches to solve AI assistants' struggles with JSON handling.

AI tends to have difficulty generating robust code for handling dynamic, recursive data structures. As a result, it often produces code that induces runtime errors (KeyError, IndexError, AttributeError, etc.) due to missing keys or type mismatches, or code where the core logic is buried under excessive defensive checks (frequent isinstance checks, None checks, cast).

To minimize AI inference costs and guide more stable implementations, CrystFlux provides a JSON accessor with the following characteristics:

  • Deep Immutability: Recursively transforms JSON data into immutable structures, eliminating state changes and side effects from the logical flow.
  • Fluent Interface: Method chains that support map and filter enable linear, structured data extraction without complex nesting or conditional branching.
  • Type-Specific Accessors: Values can be retrieved with type specifications using as_str() / expected_str(), etc. On type mismatch, as_* returns None, while expected_* raises TypeError.
  • Multi-Mode Safety: Behavior can be switched according to requirements.
Mode Description
Strict Strict mode that raises exceptions immediately on schema violations
Latent (Safe) Safe mode that treats KeyError, IndexError as None (Void) and continues the chain
Dream Research mode that even tolerates hallucinated (non-existent) method calls, continues the chain, and observes/records them (disabled by default)

Installation

pip

# Using pip
pip install crystflux
# Verify installation and version
python -c "import crystflux.v1; print(crystflux.__version__)"

uv

# Using uv
uv pip install crystflux
# Verify installation and version
uv run python -c "import crystflux.v1; print(crystflux.__version__)"

For detailed setup instructions, refer to the following files:


Getting Started

A simple usage example that you can run immediately after installation to verify that it works.

python -c "
from crystflux.v1 import Crystallizer;
val = Crystallizer.latent({'name': 'Alice', 'age': 30});
print(val.get('name').as_str());
print(val.get('age').as_int());
print(val.get('missing').as_str());
"

Result:

Alice
30
None

Usage Example

An implementation example handling semi-structured data containing missing values and type mismatches in Latent (Safe) mode.

Target Data

Prepare sample data to be used in the following examples.

data = {
    "users": [
        {"id": 1, "active": True,  "profile": {"name": "Alice", "age": 30}},
        {"id": 2, "active": True,  "profile": {"name": "Anna",  "age": 17}},
        {"id": 3, "active": 0,     "profile": None},
        {},
        {"id": 5, "active": False, "profile": {"name": "Bob"}},
        {"id": 6, "active": True,  "profile": {"name": "Carol"}}
    ]
}

from crystflux.v1 import Crystallizer, it

# Wrap the data (Latent mode)
val = Crystallizer.latent(data)

Navigating Data

Use get() and at() to navigate nested data structures.

These methods return wrapped Value objects rather than raw Python values. This enables method chaining and safe handling of missing data. To extract the actual value (str, int, etc.), use accessor methods like as_str() or as_int().

val.get("name")           # -> Value object
val.get("name").as_str()  # -> "Alice"

See Latent / Strict for Value object types and mode-specific behavior.

get() - Object Key Access

Retrieve values by specifying object keys.

val.get("users")                      # Value of "users" key (array)
val.get("users").get(0)               # NG: get() only accepts string keys

Missing keys return None in Latent mode.

val.get("missing").as_str()
# -> None

at() - Array Index Access

Retrieve elements by specifying array indices.

val.get("users").at(0)                # First user
val.get("users").at(2)                # Third user (id=3)

Out-of-range indices return None in Latent mode.

val.get("users").at(999).get("id").as_int()
# -> None

Combining get() and at()

For nested structures of objects and arrays, use get() and at() alternately.

# Get the name of the second user (index=1)
val.get("users").at(1).get("profile").get("name").as_str()
# -> "Anna"

# Safe chaining even for missing paths (Latent mode)
val.get("users").at(3).get("profile").get("name").as_str()
# -> None (user at id=4 has no profile key)

Comparison

Method Target Argument Example
get(key) Object str val.get("users")
at(index) Array int val.get("users").at(0)

Both methods raise exceptions on missing data in Strict mode. See Latent / Strict for details.

Basic Extraction

Access array elements and extract nested values. Missing keys or type mismatches along the path are treated as None (Void).

names = (
    val.get("users")
       .map(lambda u: u.get("profile").get("name"))
       .as_str_array()
)
# Result: ('Alice', 'Anna', 'Bob', 'Carol')
# (None values are excluded by .as_str_array())

Filtering and Mapping

Instead of lambda, you can also use it (Projection) to declaratively describe value type conversions and condition evaluations. Property access (.) and get() are treated equivalently. Type conversions (as_bool, as_int) safely return None (treated as False) when the target value is incompatible.

active_adults = (
    val.get("users")
       .filter(it.active.as_bool().is_true())  # Only those where active is True (bool)
       .filter(it.profile.age.as_int() >= 20)  # Only those where age is 20 or above
       .map(it.profile.name)                   # Extract names
       .as_str_array()
)
# Result: ('Alice',)

Handling Missing Structures

Structural missing (Void state) can also be explicitly detected.

Detecting missing keys:

missing_key = (
    val.get("users")
       .filter(lambda u: u.get("profile").is_void())
)
# Result: Wraps object for id=4 (empty dict - no profile key)

Detecting when value is None or key is missing:

profile_is_none = (
    val.get("users")
       .filter(lambda u: u.get("profile").as_json_value() is None)
)
# Result: Wraps objects for id=3 (profile is None) and id=4 (empty dict)

[!NOTE] In Latent mode, profile: None is treated as a valid value (is_void() returns False). Only missing keys are considered Void.

as / expected {#as-expected}

The difference between as_ methods and expected_ methods lies in their behavior when type mismatches or missing values occur. as_ returns None, while expected_ raises an exception (TypeError).

Same Result (Type Matches)

When types match, both return the same value.

from crystflux.v1 import Crystallizer

data = {
    "age": 30,
    "name": "Alice",
}

val = Crystallizer.latent(data)

val.get("age").as_int()
# -> 30
val.get("age").expected_int()
# -> 30

val.get("name").as_str()
# -> "Alice"
val.get("name").expected_str()
# -> "Alice"

Different Result (Type Mismatch or Missing)

When types differ or keys are missing, behavior diverges.

# Case 1: Type Mismatch (String is not Int)
val.get("name").as_int()
# -> None

val.get("name").expected_int()
# -> raises TypeError: Expected an integer, but got str

# Case 2: Missing Key
val.get("missing").as_str()
# -> None

val.get("missing").expected_str()
# -> raises TypeError: VOID has no string value

Primitive Type Accessors

Introduction of main accessors. Many more accessors exist. For details, refer to:

As Type Accessors

Returns None when value is missing or type mismatches

Method Return Type
as_str() str | None
as_int() int | None
as_float() float | None
as_bool() bool | None

Expected Type Accessors

Raises error when expected type value is missing

Method Return Type
expected_str() str
expected_int() int
expected_float() float
expected_bool() bool

Latent / Strict {#latent-strict}

Both modes share the same API (ValueAPI), but differ in runtime behavior when schema violations (missing keys, out-of-range indices) occur.

Reference:

Value Object Types

CrystFlux wraps JSON data as Value objects. Upon wrapping, data is recursively converted into an immutable structure—the original data is never modified by any subsequent operation. While the mode specified at creation determines behavior on missing data, all types share a common interface: get(), at(), as_str(), and more.

Type Creation Method Behavior on Missing
StrictValue Crystallizer.strict() Raises exception
LatentValue Crystallizer.latent() Returns VOID
DreamValue Crystallizer.dream() Returns VOID (observable)

VOID, generated when data is missing or an error occurs, also implements the same interface to keep chains alive. Calling accessors like as_str() on VOID returns None.

[!NOTE] Changing the mode at wrap time does not change the as_* / expected_* implementations themselves. The differing behavior is solely due to how each mode handles schema violations (missing keys, out-of-range indices).

Same Code, Different Behavior

Consider executing the same code on data with missing keys in both Latent and Strict modes.

from crystflux.v1 import Crystallizer
from crystflux.v1.core.value_api import ValueAPI

data = {"id": 1}  # 'name' is missing

def extract_name(val: ValueAPI) -> str | None:
    return val.get("name").as_str()

Latent Mode

Latent mode absorbs structural errors, propagates Void state, and ultimately returns None.

val = Crystallizer.latent(data)

print(extract_name(val))
# -> None

Strict Mode

Strict mode enforces schema immediately and raises exceptions at the point of failure.

val = Crystallizer.strict(data)

print(extract_name(val))
# -> raises KeyError: 'name'

Summary

Feature Latent Mode Strict Mode
Missing Key/Index Returns Void (evaluates to None) Raises KeyError / IndexError
Chain Execution Continues (absorbs failures) Stops immediately (Fail-fast)

Dream Mode

Dream mode is a research-focused mode for studying AI behavior during long-term autonomous operation. It observes and records hallucinations (undefined method calls) instead of ignoring them, providing insights into AI reasoning processes.

As an experimental implementation, it is disabled by default.

Features

  • Chains containing hallucinated (non-existent) method calls from AI coders continue processing while their behavior is observed and logged
  • Any hallucinated method call irreversibly transitions processing to a VOID chain
  • VOID chains produce None for final value retrieval

[!NOTE] Hallucinations are observed rather than eliminated—treated as "alternative worldlines" the AI considers more probable than the current state. With suitable feedback mechanisms, this approach could lead to hallucination-driven development methods.

[!WARNING] Regardless of whether this library is used, AI agents with self-referential and self-modifying structures (Ouroboros type) can form recursive self-evolutionary loops where observation influences their own behavior, posing risks of unexpected outcomes. Experiments must be conducted in isolated environments with proper containment, audit log preservation, and fail-safe mechanisms, under your own management and responsibility. This library is provided as-is under the MIT License, and assumes no liability for any damages.

Opt-in Required

To use Dream mode, explicit enabling is required.

from crystflux.v1 import Crystallizer
from crystflux.v1.adapters import enable_dream_mode

with enable_dream_mode():
    val = Crystallizer.dream({"name": "Alice"})

Hallucination Tolerance

Calling non-existent methods returns a DreamValue void instead of raising exceptions.

Reference:

val.some_nonexistent_method()
# -> DreamValue void (no exception)

# Chain continuation
val.some_method().another_method()
# -> DreamValue void (chain is preserved)

Observed Logging

In Dream mode, both hallucination paths and structural missing can be observed and recorded.

Undefined Method Calls (Desire Logger)

Calling non-existent methods records hallucination paths (desire paths).

from crystflux.v1.adapters import StdoutDesireLogger

logger = StdoutDesireLogger()
val = Crystallizer.dream({"name": "Alice"}, desire_logger=logger)

val.some_nonexistent_method()
# Output: [Desire] method=some_nonexistent_method target=mappingproxy repr=mappingproxy({'name': 'Alice'})

Method chains are also observed.

val.method_a().method_b()
# Output:
# [Desire] method=method_a target=mappingproxy ...
# [Desire] method=method_b target=void ...

Structural Missing (Missing Logger)

Access to missing keys or indices can be observed with MissingLogger.

from crystflux.v1.adapters import StdoutMissingLogger

logger = StdoutMissingLogger()
val = Crystallizer.dream({"name": "Alice"}, missing_logger=logger)

val.get("profile").get("age")
# Output: [Missing] reason=VoidReason.MISSING_KEY key='profile' target=mappingproxy repr=mappingproxy({'name': 'Alice'})

You can create custom loggers by implementing the DesireLogger and MissingLogger protocols.

[!IMPORTANT] In the current implementation, property chain notation like val.profile.age results in AttributeError.

Summary

Feature Dream Mode
Hallucination Tolerance Even non-existent method calls return void
Chain Execution Continues
Opt-in Explicitly enabled with enable_dream_mode()
Observation & Recording Tracks desire paths with DesireLogger

License

MIT License - See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

crystflux-0.23.12.tar.gz (177.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

crystflux-0.23.12-py3-none-any.whl (68.4 kB view details)

Uploaded Python 3

File details

Details for the file crystflux-0.23.12.tar.gz.

File metadata

  • Download URL: crystflux-0.23.12.tar.gz
  • Upload date:
  • Size: 177.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.8

File hashes

Hashes for crystflux-0.23.12.tar.gz
Algorithm Hash digest
SHA256 6d5cd23517878ee5b490a13b896797494210763288e828711c4e57dcf6f7233a
MD5 f7d8a47b19df8a8eaf0c5919a95cca07
BLAKE2b-256 6ea8e706fe7b20c43a06bd318419f4eb54a28f075e23799fa985aefbd0620c0c

See more details on using hashes here.

File details

Details for the file crystflux-0.23.12-py3-none-any.whl.

File metadata

  • Download URL: crystflux-0.23.12-py3-none-any.whl
  • Upload date:
  • Size: 68.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.13

File hashes

Hashes for crystflux-0.23.12-py3-none-any.whl
Algorithm Hash digest
SHA256 f9263748ad52a6ca1c110265dcf36e1aa17fe2f1c946dd924d03838c09050bdf
MD5 c53955e0ec21c0696912381caf60ed65
BLAKE2b-256 5a95466422650cc6642284e229ac1a525ad072c66ea919e89b3d1422432365db

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page