A high-performance library for atomic neural network weight synchronization.
Project description
Synaptic-Delta-Sync (SDS) 🚀
Synaptic-Delta-Sync (SDS) is a high-performance, production-grade infrastructure library designed for atomic, secure, and zero-downtime neural network weight updates.
In modern AI environments, updating models often requires a full restart, leading to service disruption. SDS bridges this gap by enabling hot-swapping of weights directly into live inference engines without stopping the process.
🏗️ Architecture Overview
The SDS pipeline is designed for modularity, speed, and integrity. The architecture separates weight extraction, cryptographic validation, and device-specific injection into distinct, highly optimized layers.
graph TD
subgraph "Phase 1: Preparation"
A[Live Model] -->|Extract| B[Delta Engine]
B -->|Sparse Diff| C[Serialized .sds Patch]
end
subgraph "Phase 2: Injection"
C -->|Verify| D[Patch Validator]
D -->|Hash Check| E[Atomic Injector]
end
subgraph "Phase 3: Execution"
E -->|Route| F{Device Selection}
F -->|CPU| G[Atomic Injection]
F -->|GPU| H[Async CUDA Stream]
G --> I[Updated Model]
H --> I
end
💎 Core Technical Pillars
- Atomic Injection & Zero-Downtime: SDS modifies model weights at the memory-pointer level using
torch.no_grad(), ensuring zero-drop inference. - Sparse Delta Engine: Reduces patch sizes from MBs to KBs using mathematical delta computation.
- Cryptographic Security: SHA-256 integrity handshake verifies every patch before application.
- Dual-Engine Performance: Optimized paths for both CPU (direct memory) and GPU (Async CUDA Streams).
📦 Quick Start
Installation
Clone the repository to your local workspace:
git clone [https://github.com/ANSH-GIT77/synaptic-delta-sync.git](https://github.com/ANSH-GIT77/synaptic-delta-sync.git)
cd synaptic-delta-sync
Basic Usage
The AtomicInjector class handles all the heavy lifting automatically:
from sds.core.injection import AtomicInjector
from sds.protocol.serializer import load_patch
# 1. Initialize engine
injector = AtomicInjector(model)
# 2. Load secure patch
delta, metadata, patch_hash = load_patch("updates.sds")
# 3. Apply patch
injector.apply_patch(delta, patch_hash=patch_hash)
📁 Project Structure
synaptic-delta-sync/
├── sds/
│ ├── core/ # Engine Logic
│ ├── hot_swap/ # Validation
│ └── protocol/ # Serialization
├── examples/ # Tests
└── pyproject.toml # Config
📈 Roadmap
- v0.1.0: Core Engine & Security Validator.
- Next: Distributed Patching (RPC) & Multi-GPU sharding.
🤝 Author
Ansh Nimbalkar | AI Infrastructure Engineer
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file synaptic_delta_sync-0.1.0.tar.gz.
File metadata
- Download URL: synaptic_delta_sync-0.1.0.tar.gz
- Upload date:
- Size: 7.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bdbc686453d1eb55a00e0ce06eb887f85b5652f3b614d8052fbb01fc3d9a2cd0
|
|
| MD5 |
e673de70321b59931cc0defcc237d62c
|
|
| BLAKE2b-256 |
875a9b2f763d0cc9cf4e95268c8e0ab979bde588342cb23a58937b79549a8345
|
File details
Details for the file synaptic_delta_sync-0.1.0-py3-none-any.whl.
File metadata
- Download URL: synaptic_delta_sync-0.1.0-py3-none-any.whl
- Upload date:
- Size: 8.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f6693fc31b251046cdbf3f66744bc195c8ee0fc2a30d63623fb438134ad0e00b
|
|
| MD5 |
2666381fe849cb7516592a901a698605
|
|
| BLAKE2b-256 |
93a961495fed080f6c7f069d0632ad3dd6e9032f1673de1094d64191977cb907
|