ENTRO-NET: Distributed Entropy Synchronization Protocols for Collective Neural Networks
Project description
๐ด ENTRO-NET โ Distributed Entropy Synchronization Protocols for Collective Neural Networks
"Stability is not an individual property โ it is a collective effort."
โ Samir Baladi, April 2026
ENTROPY RESEARCH LAB ยท E-LAB-06 ยท v1.0.0
๐ Overview
ENTRO-NET is the sixth project of the EntropyLab research program (E-LAB-06). It represents the leap from self-calibrating individual systems โ mastered in ENTRO-EVO (E-LAB-05) โ to distributed networked systems.
After successfully enabling a system to self-calibrate its weights via the Adaptive Entropy Weighting (AEW) algorithm with a 78.1% error reduction, this research builds a protocol that allows multiple nodes to physically share their stability states. The goal is to prevent cascading failure by synchronizing entropy flows across the network.
Extended empirical validation across N = 2 to N = 50 nodes reveals a non-trivial crossover from near-linear variance growth to a bounded saturation regime, with no catastrophic failure observed for any tested configuration.
๐ฏ Core Innovations
| Component | Description |
|---|---|
| ฮจ-Sync Protocol | Real-time sharing of the entropy state ฮจ(t) between nodes โ stable nodes absorb informational pressure from stressed nodes |
| Collective-AEW | Extension of the single-node AEW algorithm: each node learns from both its own experience and the collective stability history of the entire network |
| ฮธ_net Threshold | Dynamic networked threshold elevated from local to global level, ensuring the system responds as a coherent single entity |
| Fault Isolation | Automatic isolation of nodes exceeding ฮจ_critical to prevent entropic contagion from propagating to stable regions |
๐ Mathematical Framework
Collective State:
ฮจ_net(t) = { ฮจ_1(t), ฮจ_2(t), ..., ฮจ_N(t) }
Entropy Synchronization Signal:
ฮด_i_sync(t) = ฮบ ยท ฮฃ_{j โ i} [ ฮจ_j(t) โ ฮจ_i(t) ]
Collective-AEW Weight Update:
w_i(t+1) = w_i(t) โ ฮท ยท [ โL_local(t) + ฮฒ ยท โL_collective(t) ]
Networked Threshold:
ฮธ_net(t) = ฮธ_base + ฮณ ยท Var[ ฮจ_net(t) ]
Global Lyapunov Stability Candidate:
V_net(t) = (1/2) ยท ฮฃ_{i=1}^{N} [ ฮจ_i(t) โ ฮจ_target ]ยฒ
๐ Technical Objectives
| Objective | Technical Description | Expected Outcome |
|---|---|---|
| Distributed Stability | Balance ฮจ state across at least 3 distributed nodes | Reduce total entropy variance by > 50% |
| Networked Transfer | Instant transfer of optimal weights [wโ, wโ, wโ] between nodes | Reduce adaptation time for new nodes by > 70% |
| Fault Isolation | Isolate nodes exceeding ฮจ_critical | 100% protection for remaining network members |
๐ Scaling Results
Extended Analysis (N = 20, 30, 50)
Systematic experiments under the scraper regime (800 steps, 4 repetitions per N):
| N | Variance (mean ยฑ std) |
|---|---|
| 20 | 0.165380 ยฑ 0.002169 |
| 30 | 0.197713 ยฑ 0.002204 |
| 50 | 0.221481 ยฑ 0.000677 |
Comparison with Linear Extrapolation
Linear model fitted for N โค 15: ฯยฒ = 0.0101ยทN โ 0.0331 (Rยฒ = 0.986)
| N | Linear Prediction | Actual Variance | Deviation |
|---|---|---|---|
| 20 | 0.1689 | 0.1654 | โ2.1% |
| 30 | 0.2699 | 0.1977 | โ26.7% |
| 50 | 0.4719 | 0.2215 | โ53.1% |
Key finding: Linear scaling breaks down beyond N โ 20. The system enters a saturation regime where additional nodes contribute progressively less to global variance.
Scaling Curve
0.25 โค
โ โ
N=50
0.20 โค โ
โ โ
โ โ
0.15 โค โ
โ โ
โ โ
0.10 โค โ
โ โ
โโ
0.05 โคโ
โ
0.00 โผโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ N
0 5 10 15 20 25 30 35 40 45 50
โ Empirical data points (mean variance)
โโ Linear fit (N โค 15): ฯยฒ = 0.0101ยทN โ 0.0331
โโ Saturation fit: ฯยฒ = 0.228ยท(1 โ e^{โN/16.2})
โ Crossover region (N โ 15โ25)
๐ฌ Scaling Regimes
| Regime | N Range | Behavior | Description |
|---|---|---|---|
| Linear Accumulation | 2 โ 15 | ฯยฒ โ 0.0101ยทN โ 0.0331 | Near-linear growth, Rยฒ = 0.986 |
| Transition | 15 โ 25 | Bending toward saturation | Crossover zone |
| Saturation | 25 โ 50 | ฯยฒ โ 0.22 | Variance ceiling observed |
๐ Proposed Saturation Model
ฯยฒ(N) = ฯยฒ_max ยท (1 โ e^{โN/Nโ})
| Parameter | Symbol | Value | Interpretation |
|---|---|---|---|
| Saturation ceiling | ฯยฒ_max | 0.228 | Maximum variance asymptote |
| Characteristic scale | Nโ | 16.2 | Crossover scale (nodes) |
| Goodness of fit | Rยฒ | 0.992 | โ |
| Root mean square error | RMSE | 0.004 | โ |
Asymptotic properties:
- For small N:
ฯยฒ โ (ฯยฒ_max / Nโ) ยท Nโ linear growth - For large N:
ฯยฒ โ ฯยฒ_maxโ bounded variance
๐ง Key Scientific Insights
1. No Catastrophic Failure
The system remains stable and operational for all tested configurations (N โค 50). Variance does not diverge.
2. Intrinsic Self-Regulation
Variance growth is actively constrained by three emergent internal mechanisms:
- Adaptive aggression auto-tuning (ฮฑ self-adjusts)
- Collective-AEW weight redistribution
- Networked threshold elevation (ฮธ_net)
3. Smooth Crossover
The transition from linear growth to saturation is gradual โ a soft scaling crossover rather than a sharp phase transition.
4. Bounded Variance Ceiling
The system approaches a natural ceiling ฯยฒ โ 0.23, independent of further node addition beyond N โ 30.
๐ Practical Recommendations
| Use Case | Recommended N | Expected Variance | Reliability |
|---|---|---|---|
| Production (critical) | 2 โ 5 | < 0.05 | ๐ข Excellent |
| Production (standard) | 6 โ 12 | 0.05 โ 0.09 | ๐ข Good |
| Experimental | 13 โ 20 | 0.09 โ 0.17 | ๐ก Acceptable |
| Research / Development | 21 โ 30 | 0.17 โ 0.20 | ๐ด Degraded |
| Not recommended | > 30 | > 0.20 | โ ๏ธ Saturated |
๐ Project Structure
ENTRO-NET/
โ
โโโ entro_net/ # Core library
โ โโโ __init__.py
โ โโโ psi_sync.py # ฮจ-Sync protocol
โ โโโ collective_aew.py # Collective-AEW optimizer
โ โโโ net_threshold.py # ฮธ_net dynamic threshold
โ โโโ fault_isolation.py # Cascading failure prevention
โ โโโ simulator.py # Distributed simulation engine
โ
โโโ bin/ # Executables
โ โโโ run_simulation.py
โ
โโโ tests/ # Unit and integration tests
โโโ examples/ # Usage examples
โโโ scripts/ # Utility scripts
โโโ docs/ # Documentation
โโโ results/ # Simulation outputs
โโโ Netlify/ # Static website
โก Quick Start
from entro_net import PsiSync, CollectiveAEW, NetThreshold
# Initialize 3-node network
sync = PsiSync(n_nodes=3)
collective = CollectiveAEW(eta=0.01, target=0.339)
threshold = NetThreshold(theta_base=1.2)
# Run distributed control loop
for t in range(500):
psi_states = [node.observe() for node in nodes]
# Synchronize entropy states across network
synced_psi = sync.broadcast(psi_states)
# Collective weight adaptation
weights = collective.step(synced_psi)
# Apply global networked threshold
theta = threshold.update(synced_psi)
# Isolate faulty nodes if needed
if sync.detect_fault(psi_states):
sync.isolate_node(faulty_id)
Reproduce all experiments:
python bin/run_simulation.py \
--nodes N \
--steps 800 \
--regime scraper \
--repeats 4
๐ Roadmap Integration
| Project | Code | Contribution to ENTRO-NET |
|---|---|---|
| ENTROPIA | E-LAB-01 | Unified Dissipation State Function โ foundational entropy formalism |
| ENTRO-AI | E-LAB-02 | AI risk monitoring โ dynamic entropy threshold design |
| ENTRO-CORE | E-LAB-03 | Singular system will โ local AEW weight architecture |
| ENTRO-ENGINE | E-LAB-04 | Budget distribution between coupled systems |
| ENTRO-EVO | E-LAB-05 | Self-learning AEW โ 78.1% error reduction baseline |
| ENTRO-NET | E-LAB-06 | Collective ฮจ-Sync โ distributed stability (this work) |
๐ Links & Resources
| Resource | URL |
|---|---|
| ๐ Paper (Zenodo) | 10.5281/zenodo.19474217 |
| ๐ OSF Preregistration | 10.17605/OSF.IO/9Y7RX |
| ๐ป GitLab | gitlab.com/gitdeeper10/ENTRO-NET |
| ๐ป GitHub | github.com/gitdeeper10/ENTRO-NET |
| ๐ป Bitbucket | bitbucket.org/gitdeeper-10/entro-net |
| ๐ป Codeberg | codeberg.org/gitdeeper10/entro-net |
| ๐ฆ PyPI | pypi.org/project/entro-net |
| ๐ Website | entro-net.netlify.app |
๐ Citation
@software{baladi2026entronet,
author = {Baladi, Samir},
title = {ENTRO-NET: Distributed Entropy Synchronization Protocols
for Collective Neural Networks},
year = {2026},
version = {1.0.0},
doi = {10.5281/zenodo.19474217},
url = {https://github.com/gitdeeper10/ENTRO-NET},
note = {E-LAB-06. Builds on E-LAB-01 through E-LAB-05.
EntropyLab Research Program.
OSF Preregistration: 10.17605/OSF.IO/9Y7RX}
}
๐ค Author
Samir Baladi
Interdisciplinary AI & Theoretical Physics Researcher
Ronin Institute / Rite of Renaissance
- ๐ง gitdeeper@gmail.com
- ๐ ORCID: 0009-0003-8903-0029
- ๐ป GitLab / GitHub / Codeberg: @gitdeeper10
๐ License
MIT License โ see LICENSE file for details.
Part of the EntropyLab ten-project research program ยท E-LAB-06 โ Complete
"Intelligence by Design, Stability by Physics, Evolution by Learning, Harmony by Network"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file entro_net-1.0.0.tar.gz.
File metadata
- Download URL: entro_net-1.0.0.tar.gz
- Upload date:
- Size: 27.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: ENTRO-NET-Uploader/1.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d15621f7bd4f1e433e93e1c001384e70ab584af1661f0f8f926daa01ef4d7066
|
|
| MD5 |
5e84338af8422b8fb5c459feee00ac8f
|
|
| BLAKE2b-256 |
67adb90142c43600cc49371378a4ae035d7d5f6f56fb5af2dae164287733f490
|
File details
Details for the file entro_net-1.0.0-py3-none-any.whl.
File metadata
- Download URL: entro_net-1.0.0-py3-none-any.whl
- Upload date:
- Size: 14.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: ENTRO-NET-Uploader/1.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f9744173629b16b53d74c35aa9fa497c7132a931bd3f62bdaac47f22d2b59319
|
|
| MD5 |
1312ec82beee2fe23a9432297b180c68
|
|
| BLAKE2b-256 |
7b91868dcf17ace5fc83c069a7868e6431ea7949a89d4f5b16cabfccdfdc5ec9
|