🚀 JSD (JSON Database)
The next-generation JSON storage format for Python
🌟 Overview
JSD revolutionizes JSON storage by combining cutting-edge compression techniques with lightning-fast serialization. Built for performance-critical applications, JSD delivers unmatched read speeds and exceptional storage efficiency.
✨ Key Features
- 🏃♂️ Blazing Fast Reads: Up to 5x faster than traditional JSON libraries
- 💾 Superior Compression: Up to 70% reduction in storage footprint
- 🧠 Memory Efficient: Optimized memory utilization during operations
- 🛠️ Modern Architecture: Leverages cutting-edge Python technologies
- 📊 Rich Analytics: Comprehensive benchmarking and visualization suite
🚀 Quick Start
Installation
# Create and activate virtual environment
python -m venv .venv
source .venv/bin/activate # Linux/Mac
.venv\Scripts\activate # Windows
# Install dependencies
pip install -r requirements.txt
Basic Usage
🏗️ Architecture
JSD employs a sophisticated multi-layer architecture:
-
Binary Serialization 🔄
- Powered by
msgspecfor maximum performance - Custom-optimized binary format
- Intelligent type handling
- Powered by
-
Compression Layer 📦
- LZ4 frame compression
- Adaptive compression levels
- Optimized for both speed and size
-
Storage Format 💾
- Custom binary format with magic bytes
- Fixed-size header for fast seeking
- Versioned format support
📈 Performance
JSD delivers exceptional performance metrics:
| Operation | vs orjson | vs msgspec | File Size Reduction |
|---|---|---|---|
| Read (10k) | 4.5x faster | 4.2x faster | 71% smaller |
| Write (10k) | 1.1x faster | 1.0x faster | 71% smaller |
For detailed benchmarks, see BENCHMARK.md
🛠️ Development Tools
Included Utilities
- 📊 Benchmark Suite: Comprehensive performance testing
- 📈 Visualization Tools: Advanced performance analytics
- 🔧 Data Generators: Sophisticated test data creation
- 🧪 Test Suite: Extensive unit and integration tests
🤝 Contributing
We welcome contributions! Here's how you can help:
- 🍴 Fork the repository
- 🌿 Create your feature branch
- 💻 Commit your changes
- 🚀 Push to the branch
- 🎉 Open a Pull Request
📜 License
MIT License - see LICENSE for details
🙏 Acknowledgments
- LZ4 - Exceptional compression library
- msgspec - Ultra-fast serialization
- Python - The foundation of it all
Made with ❤️ by Alaamer
1 maintainer
Metadata
1 maintainer
Release files for jsdfile 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| jsdfile-0.1.0.tar.gz | 22.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| jsdfile-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 42.6 kB
Release files / jsdfile-0.1.0.tar.gz
| Download URL | jsdfile-0.1.0.tar.gz |
|---|---|
| Size | 22.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
77111ffa97926437a467f646e7cd6de8bceed356f8414dc96f3e16df577d8088
|
|
BLAKE2b-256 checksum How to use checksums |
72b31b5c86ac116d706443dfa205c7d3d303be66e3d488153e78a7ccfea66f04
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.6
|
Release files / jsdfile-0.1.0-py3-none-any.whl
| Download URL | jsdfile-0.1.0-py3-none-any.whl |
|---|---|
| Size | 19.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
59d8b8a9d2962b8f2d7ebd4b0210e27009cfbfaa3226b7a3d6d9b9f969bd1a2b
|
|
BLAKE2b-256 checksum How to use checksums |
85ed61184644363917bceafc965769d6441a2a445d476584d46428a9c65d848a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.6
|
