Graph Context component for Knowledge Graph Assisted Research IDE
Project description
A flexible and type-safe graph database abstraction layer for Python, providing a robust foundation for building graph-based applications with strong validation and transaction support.
Table of Contents
-
🔍 Type-Safe: Full type hints and runtime type checking
-
🔒 Schema Validation: Strict schema validation for entities and relations
-
💼 Transaction Support: ACID-compliant transactions with commit/rollback
-
🎯 Property Validation: Rich property validation with constraints
-
🌐 Graph Operations: Comprehensive graph traversal and query capabilities
-
🔌 Extensible: Easy to implement custom storage backends
-
🧪 Well-Tested: High test coverage and comprehensive test suite
-
📡 Event System: Sophisticated pub/sub system with metadata tracking and bulk operation support
-
💾 Caching Support: Flexible caching system with various backend options
-
🛡️ Error Handling: Comprehensive error handling with detailed error types
-
📊 Bulk Operations: Efficient bulk entity and relation operations
-
🔄 Metadata Tracking: Detailed operation metadata for debugging and monitoring
Installation
pip install graph-context
Quick Start
from graph_context import BaseGraphContext
from graph_context.types import EntityType, PropertyDefinition, RelationType
# Define your schema
class MyGraphContext(BaseGraphContext):
async def initialize(self) -> None:
# Register entity types
self.register_entity_type(EntityType(
name="Person",
properties={
"name": PropertyDefinition(type="string", required=True),
"age": PropertyDefinition(type="integer", required=False)
}
))
# Register relation types
self.register_relation_type(RelationType(
name="KNOWS",
from_types=["Person"],
to_types=["Person"]
))
async def cleanup(self) -> None:
pass
# Use the graph context
async def main():
context = MyGraphContext()
await context.initialize()
# Start a transaction
await context.begin_transaction()
try:
# Create entities
alice_id = await context.create_entity(
entity_type="Person",
properties={"name": "Alice", "age": 30}
)
bob_id = await context.create_entity(
entity_type="Person",
properties={"name": "Bob", "age": 25}
)
# Create relation
await context.create_relation(
relation_type="KNOWS",
from_entity=alice_id,
to_entity=bob_id
)
# Commit the transaction
await context.commit_transaction()
except:
# Rollback on error
await context.rollback_transaction()
raise
if __name__ == "__main__":
import asyncio
asyncio.run(main())
Core Concepts
Event System
The graph-context library includes a sophisticated event system that allows you to:
- Subscribe to graph operations (entity/relation CRUD, queries, traversals)
- Track detailed operation metadata
- Handle bulk operations efficiently
- Implement cross-cutting concerns like caching and logging
Example usage:
from graph_context import GraphEvent
async def log_entity_changes(event_context):
metadata = event_context.metadata
print(f"Entity changed: {metadata.entity_type} at {metadata.timestamp}")
print(f"Operation ID: {metadata.operation_id}")
# Subscribe to entity write events
await context.event_system.subscribe(GraphEvent.ENTITY_WRITE, log_entity_changes)
Entities
Entities are nodes in the graph with:
- Type definitions (e.g., "Person", "Document")
- Properties with validation rules
- Unique IDs
Relations
Relations are edges connecting entities with:
- Type definitions (e.g., "KNOWS", "AUTHORED")
- Direction (from_entity → to_entity)
- Optional properties
- Type constraints
Transactions
All operations can be wrapped in transactions:
- Begin/commit/rollback support
- Isolation of changes
- Atomic operations
- Consistent state
- Event emission for transaction lifecycle
- Automatic metadata tracking
Example with error handling:
try:
await context.begin_transaction()
# Create entities with validation
try:
alice_id = await context.create_entity(
entity_type="Person",
properties={"name": "Alice", "age": 30}
)
except ValidationError as e:
print(f"Validation failed: {e.detail}")
await context.rollback_transaction()
return
# Create relation with type checking
try:
await context.create_relation(
relation_type="KNOWS",
from_entity=alice_id,
to_entity=bob_id
)
except (EntityNotFoundError, SchemaError) as e:
print(f"Relation creation failed: {e}")
await context.rollback_transaction()
return
await context.commit_transaction()
except TransactionError as e:
print(f"Transaction error: {e}")
await context.rollback_transaction()
### Validation
Comprehensive validation system:
- Schema validation
- Property type checking
- Required/optional fields
- Default values
- Custom constraints (patterns, ranges, etc.)
## Architecture
### Component Overview
```mermaid
graph TD
A[Client Application] --> B[GraphContext Interface]
B --> C[BaseGraphContext]
C --> D[Custom Implementation]
C --> E[TestGraphContext]
C --> F[Event System]
C --> G[Cache Layer]
F --> H[Event Handlers]
G --> I[Cache Backend]
subgraph "Core Components"
B
C
F
G
end
subgraph "Implementations"
D
E
H
I
end
style A fill:#f9f,stroke:#333,stroke-width:2px
style B fill:#bbf,stroke:#333,stroke-width:2px
style C fill:#dfd,stroke:#333,stroke-width:2px
style F fill:#ffd,stroke:#333,stroke-width:2px
style G fill:#dff,stroke:#333,stroke-width:2px
Class Structure
classDiagram
class GraphContext {
<<interface>>
+initialize()
+cleanup()
+create_entity()
+get_entity()
+update_entity()
+delete_entity()
+create_relation()
+get_relation()
+update_relation()
+delete_relation()
+query()
+traverse()
+begin_transaction()
+commit_transaction()
+rollback_transaction()
}
class BaseGraphContext {
#_entity_types: Dict
#_relation_types: Dict
#_in_transaction: bool
#_event_system: EventSystem
#_cache_layer: CacheLayer
+register_entity_type()
+register_relation_type()
+validate_entity()
+validate_relation()
#_check_transaction()
#_emit_event()
}
class EventSystem {
-_handlers: Dict
-_enabled: bool
+subscribe()
+unsubscribe()
+emit()
+enable()
+disable()
}
class EventContext {
+event: GraphEvent
+metadata: EventMetadata
+data: Dict
}
class CustomImplementation {
-storage_backend
-cache_backend
+initialize()
+cleanup()
+create_entity()
+get_entity()
... other implementations
}
GraphContext <|-- BaseGraphContext
BaseGraphContext <|-- CustomImplementation
BaseGraphContext --> EventSystem
EventSystem --> EventContext
Transaction Flow
sequenceDiagram
participant C as Client
participant G as GraphContext
participant E as Event System
participant T as Transaction Manager
participant S as Storage
C->>G: begin_transaction()
G->>E: emit(TRANSACTION_BEGIN)
G->>T: create transaction
T->>S: create snapshot
C->>G: create_entity()
G->>E: emit(ENTITY_WRITE)
G->>T: validate & store
T->>S: store in transaction
alt Success
C->>G: commit_transaction()
G->>E: emit(TRANSACTION_COMMIT)
G->>T: commit changes
T->>S: apply changes
else Error
C->>G: rollback_transaction()
G->>E: emit(TRANSACTION_ROLLBACK)
G->>T: rollback changes
T->>S: restore snapshot
end
Event System Architecture
flowchart TD
A[Graph Operation] -->|Triggers| B[Event Emission]
B --> C[Event Context Creation]
C --> D[Metadata Generation]
D --> E[Handler Execution]
subgraph "Event Context"
F[Event Type]
G[Operation Metadata]
H[Operation Data]
end
subgraph "Metadata"
I[Operation ID]
J[Timestamp]
K[Type Information]
L[Bulk Operation Info]
end
subgraph "Handlers"
M[Caching]
N[Logging]
O[Monitoring]
P[Custom Logic]
end
E --> M
E --> N
E --> O
E --> P
style A fill:#f9f
style B fill:#bbf
style C fill:#dfd
style D fill:#ffd
style E fill:#dff
Validation Pipeline
flowchart LR
A[Input] --> B{Schema Check}
B -->|Valid| C{Type Check}
B -->|Invalid| E[Schema Error]
C -->|Valid| D{Constraint Check}
C -->|Invalid| F[Type Error]
D -->|Valid| G[Validated Data]
D -->|Invalid| H[Validation Error]
style A fill:#f9f
style E fill:#f66
style F fill:#f66
style H fill:#f66
style G fill:#6f6
API Reference
Entity Operations
# Create an entity
entity_id = await context.create_entity(
entity_type="Person",
properties={"name": "Alice"}
)
# Get an entity
entity = await context.get_entity(entity_id)
# Update an entity
await context.update_entity(
entity_id,
properties={"age": 31}
)
# Delete an entity
await context.delete_entity(entity_id)
Relation Operations
# Create a relation
relation_id = await context.create_relation(
relation_type="KNOWS",
from_entity=alice_id,
to_entity=bob_id,
properties={"since": 2023}
)
# Get a relation
relation = await context.get_relation(relation_id)
# Update a relation
await context.update_relation(
relation_id,
properties={"strength": "close"}
)
# Delete a relation
await context.delete_relation(relation_id)
Query and Traversal
# Query relations
results = await context.query({
"start": alice_id,
"relation": "KNOWS",
"direction": "outbound"
})
# Traverse the graph
results = await context.traverse(
start_entity=alice_id,
traversal_spec={
"max_depth": 2,
"relation_types": ["KNOWS"],
"direction": "any"
}
)
Development
Setup
# Clone the repository
git clone https://github.com/yourusername/graph-context.git
cd graph-context
# Create and activate virtual environment
python -m venv .venv
source .venv/bin/activate # On Windows: .venv\Scripts\activate
# Install dependencies
pip install -e ".[dev]"
Running Tests
# Run all tests
pytest
# Run tests with coverage
pytest --cov=src/graph_context
# Run specific test file
pytest tests/graph_context/test_context_base.py
Code Style
This project uses ruff for code formatting and linting:
# Format code
ruff format .
# Run linter
ruff check .
Contributing
Contributions are welcome! Please feel free to submit a Pull Request. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.
Guidelines
- Fork the repository
- Create your feature branch (
git checkout -b feature/amazing-feature) - Commit your changes (
git commit -m 'Add some amazing feature') - Push to the branch (
git push origin feature/amazing-feature) - Open a Pull Request
License
This project is licensed under the MIT License - see the LICENSE file for details.
Acknowledgments
- Thanks to all contributors who have helped shape this project
- Inspired by graph database concepts and best practices
Documentation
- Graph Context Architecture
- Event System - Flexible pub/sub system for implementing cross-cutting concerns
- Caching Implementation Plan
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file graph_context-0.3.2.tar.gz.
File metadata
- Download URL: graph_context-0.3.2.tar.gz
- Upload date:
- Size: 95.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c826cbf75cfb86b09fd66155d2e3b516d567b461c453c81a36c8003753910dcc
|
|
| MD5 |
060c42033d45eb80a8cfcc9c2ecb3e9c
|
|
| BLAKE2b-256 |
06a1ba824eb08dc6a9604b1bfe9c543cf9ad8da544c788ed3e82ad49126224b1
|
Provenance
The following attestation bundles were made for graph_context-0.3.2.tar.gz:
Publisher:
publish.yml on beanone/graph-context
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
graph_context-0.3.2.tar.gz -
Subject digest:
c826cbf75cfb86b09fd66155d2e3b516d567b461c453c81a36c8003753910dcc - Sigstore transparency entry: 203310851
- Sigstore integration time:
-
Permalink:
beanone/graph-context@97d2373efe5ffa3b9b8655e55ec68b1d3b12b10c -
Branch / Tag:
refs/tags/v0.3.2 - Owner: https://github.com/beanone
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@97d2373efe5ffa3b9b8655e55ec68b1d3b12b10c -
Trigger Event:
push
-
Statement type:
File details
Details for the file graph_context-0.3.2-py3-none-any.whl.
File metadata
- Download URL: graph_context-0.3.2-py3-none-any.whl
- Upload date:
- Size: 44.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ac75cd60d8a9e421ab961632b2231e590fa1967ccba26e3f31c2c2cd8ebbf89
|
|
| MD5 |
49035a3f200095de36f8905ac989e4e9
|
|
| BLAKE2b-256 |
c3037ac4caebaaf3d83f1a949ce39c577f6cf12cef785e13e2d50ee45fbd53c6
|
Provenance
The following attestation bundles were made for graph_context-0.3.2-py3-none-any.whl:
Publisher:
publish.yml on beanone/graph-context
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
graph_context-0.3.2-py3-none-any.whl -
Subject digest:
2ac75cd60d8a9e421ab961632b2231e590fa1967ccba26e3f31c2c2cd8ebbf89 - Sigstore transparency entry: 203310852
- Sigstore integration time:
-
Permalink:
beanone/graph-context@97d2373efe5ffa3b9b8655e55ec68b1d3b12b10c -
Branch / Tag:
refs/tags/v0.3.2 - Owner: https://github.com/beanone
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yml@97d2373efe5ffa3b9b8655e55ec68b1d3b12b10c -
Trigger Event:
push
-
Statement type: