A simple JSON-based database for Python applications
Project description
Simple JSON DB
A lightweight, type-safe JSON-based database for Python applications using dataclasses. Perfect for small projects, prototyping, and situations where you need a simple persistent storage solution with type safety.
Features
- 🚀 Type-safe: Uses Python dataclasses for structured data
- 📁 File-based: Uses JSON files for storage - easy to inspect and backup
- 🔍 Query support: Find records using attribute-based queries
- 🔧 CRUD operations: Create, Read, Update, Delete operations
- � Primary key support: Optional configurable primary key with uniqueness enforcement
- ⚡ Indexing: Automatic indexing for primary key operations for fast lookups
- �📦 Zero dependencies: No external dependencies required
- 🐍 Type hints: Full type hint support with generics
- ✅ Well tested: Comprehensive test suite
- 🆔 UUID support: Automatic handling of UUID fields
Installation
Install from PyPI using pip:
pip install typed-json-db
Or using uv:
uv add typed-json-db
Quick Start
from dataclasses import dataclass
from enum import Enum
import uuid
from pathlib import Path
from typed_json_db import JsonDB
# Define your data structure using dataclasses
class Status(Enum):
PENDING = "pending"
ACTIVE = "active"
COMPLETED = "completed"
@dataclass
class User:
id: uuid.UUID
name: str
email: str
status: Status
age: int
# Create or connect to a database
db = JsonDB(User, Path("users.json"))
# Or create with a primary key for better performance and uniqueness enforcement
db = JsonDB(User, Path("users.json"), primary_key="id")
# Add records
user1 = User(
id=uuid.uuid4(),
name="Alice Johnson",
email="alice@example.com",
status=Status.ACTIVE,
age=30
)
db.add(user1)
# Find records
active_users = db.find(status=Status.ACTIVE)
specific_user = db.get(user1.id)
all_users = db.all()
# Update records (modify and save)
user1.age = 31
db.update(user1)
# Remove records
db.remove(user1.id)
API Reference
JsonDB[T](data_class: Type[T], file_path: Path, primary_key: Optional[str] = None)
Create a new type-safe database instance.
Parameters:
data_class: The dataclass type this database will storefile_path: Path to the JSON database fileprimary_key: Optional field name to use as primary key for uniqueness and indexing
Methods
add(item: T) -> T
Add a new item to the database and save automatically. If a primary key is configured, enforces uniqueness.
get(primary_key_value: Any) -> Optional[T]
Get an item by its primary key value. Returns None if not found. Requires a primary key to be configured.
find(**kwargs) -> List[T]
Find all items matching the given attribute criteria. Requires at least one search criterion.
all() -> List[T]
Get all items in the database.
update(item: T) -> T
Update an existing item (by primary key) and save automatically. Requires a primary key to be configured.
remove(primary_key_value: Any) -> bool
Remove an item by its primary key value. Returns True if removed, False if not found. Requires a primary key to be configured.
save() -> None
Manually save the database (automatic for add/update/remove operations).
Advanced Features
Primary Key Configuration
Configure a primary key for better performance and data integrity:
@dataclass
class Product:
sku: str
name: str
price: float
# Use 'sku' as primary key
db = JsonDB(Product, Path("products.json"), primary_key="sku")
# Primary key operations are fast (O(1)) and enforce uniqueness
product = Product(sku="ABC123", name="Widget", price=9.99)
db.add(product)
# Fast retrieval by primary key
found = db.get("ABC123")
# Trying to add duplicate primary key raises an exception
duplicate = Product(sku="ABC123", name="Another Widget", price=19.99)
# db.add(duplicate) # Raises JsonDBException
Database Operations Without Primary Key
You can still use the database without a primary key, but some operations will be limited:
# No primary key specified
db = JsonDB(User, Path("users.json"))
# These work normally
db.add(user)
users = db.find(status=Status.ACTIVE)
all_users = db.all()
# These require a primary key and will raise JsonDBException
# db.get(some_id) # Not available
# db.update(user) # Not available
# db.remove(some_id) # Not available
Automatic Type Conversion
The database automatically handles serialization/deserialization of:
- UUID fields
- Enum values
- datetime and date objects
- Complex nested dataclass structures
Performance and Indexing
When a primary key is configured, the database automatically creates an in-memory index for fast lookups:
- Primary key operations (
get, single-keyfind) are O(1) - constant time - Non-primary key searches use linear search - O(n) time
- Index is automatically maintained during add, update, and remove operations
- Index is rebuilt when loading the database from disk
# Fast O(1) operations with primary key
db = JsonDB(User, Path("users.json"), primary_key="id")
user = db.get(user_id) # Very fast, uses index
# Linear search operations (still fast for reasonable dataset sizes)
active_users = db.find(status=Status.ACTIVE) # Searches all records
Error Handling
from typed_json_db import JsonDBException
try:
db.add(invalid_item)
except JsonDBException as e:
print(f"Database error: {e}")
Development
This project uses uv for dependency management and packaging.
Setup Development Environment
# Clone the repository
git clone https://github.com/frangiz/typed-json-db.git
cd typed-json-db
# Install development dependencies
uv sync
Running Tests
make test
Code Formatting and Checking
make format
make check
Building the Package
make build
Publishing to PyPI
# Test on TestPyPI first
make publish-test
# Publish to PyPI
make publish
License
This project is licensed under the MIT License - see the LICENSE file for details.
Contributing
Contributions are welcome! Please feel free to submit a Pull Request.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file typed_json_db-0.2.3.tar.gz.
File metadata
- Download URL: typed_json_db-0.2.3.tar.gz
- Upload date:
- Size: 15.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b36ac460a1c3872b97a395b8b77ecf97906f71be14634567d9f71b2c9591a510
|
|
| MD5 |
e47f9a833856c94fb2beddc7ad4ef660
|
|
| BLAKE2b-256 |
018fd448371319c1f0e53212a48082c0bd7eea2eef9f5a452c8268dffcd3dfdd
|
Provenance
The following attestation bundles were made for typed_json_db-0.2.3.tar.gz:
Publisher:
deploy-pypi.yml on frangiz/typed-json-db
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
typed_json_db-0.2.3.tar.gz -
Subject digest:
b36ac460a1c3872b97a395b8b77ecf97906f71be14634567d9f71b2c9591a510 - Sigstore transparency entry: 582627380
- Sigstore integration time:
-
Permalink:
frangiz/typed-json-db@86f2a5d942f6244e9fe3af7fda254c6a9f3bd77d -
Branch / Tag:
refs/heads/main - Owner: https://github.com/frangiz
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
deploy-pypi.yml@86f2a5d942f6244e9fe3af7fda254c6a9f3bd77d -
Trigger Event:
push
-
Statement type:
File details
Details for the file typed_json_db-0.2.3-py3-none-any.whl.
File metadata
- Download URL: typed_json_db-0.2.3-py3-none-any.whl
- Upload date:
- Size: 9.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
68a61a3c5f49cfb0ae20df1ff12dac7bf48ec9fddb4f34240ec9340d3fe368ab
|
|
| MD5 |
bfe6795ee55676748fde883b40837d29
|
|
| BLAKE2b-256 |
74532b0709aff73efd9d8b61cbb048118fbd73eaedb653affb6fea5fe9efcb90
|
Provenance
The following attestation bundles were made for typed_json_db-0.2.3-py3-none-any.whl:
Publisher:
deploy-pypi.yml on frangiz/typed-json-db
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
typed_json_db-0.2.3-py3-none-any.whl -
Subject digest:
68a61a3c5f49cfb0ae20df1ff12dac7bf48ec9fddb4f34240ec9340d3fe368ab - Sigstore transparency entry: 582627389
- Sigstore integration time:
-
Permalink:
frangiz/typed-json-db@86f2a5d942f6244e9fe3af7fda254c6a9f3bd77d -
Branch / Tag:
refs/heads/main - Owner: https://github.com/frangiz
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
deploy-pypi.yml@86f2a5d942f6244e9fe3af7fda254c6a9f3bd77d -
Trigger Event:
push
-
Statement type: