Skip to main content

ENTRO-NET: Distributed Entropy Synchronization Protocols for Collective Neural Networks

Project description

๐Ÿ”ด ENTRO-NET โ€” Distributed Entropy Synchronization Protocols for Collective Neural Networks

"Stability is not an individual property โ€” it is a collective effort."
โ€” Samir Baladi, April 2026

ENTROPY RESEARCH LAB ยท E-LAB-06 ยท v1.0.0

DOI OSF License: MIT Python 3.11+ PyPI GitLab GitHub Bitbucket Codeberg


๐Ÿ“‹ Overview

ENTRO-NET is the sixth project of the EntropyLab research program (E-LAB-06). It represents the leap from self-calibrating individual systems โ€” mastered in ENTRO-EVO (E-LAB-05) โ€” to distributed networked systems.

After successfully enabling a system to self-calibrate its weights via the Adaptive Entropy Weighting (AEW) algorithm with a 78.1% error reduction, this research builds a protocol that allows multiple nodes to physically share their stability states. The goal is to prevent cascading failure by synchronizing entropy flows across the network.

Extended empirical validation across N = 2 to N = 50 nodes reveals a non-trivial crossover from near-linear variance growth to a bounded saturation regime, with no catastrophic failure observed for any tested configuration.


๐ŸŽฏ Core Innovations

Component Description
ฮจ-Sync Protocol Real-time sharing of the entropy state ฮจ(t) between nodes โ€” stable nodes absorb informational pressure from stressed nodes
Collective-AEW Extension of the single-node AEW algorithm: each node learns from both its own experience and the collective stability history of the entire network
ฮธ_net Threshold Dynamic networked threshold elevated from local to global level, ensuring the system responds as a coherent single entity
Fault Isolation Automatic isolation of nodes exceeding ฮจ_critical to prevent entropic contagion from propagating to stable regions

๐Ÿ“ Mathematical Framework

Collective State:

ฮจ_net(t) = { ฮจ_1(t), ฮจ_2(t), ..., ฮจ_N(t) }

Entropy Synchronization Signal:

ฮด_i_sync(t) = ฮบ ยท ฮฃ_{j โ‰  i} [ ฮจ_j(t) โˆ’ ฮจ_i(t) ]

Collective-AEW Weight Update:

w_i(t+1) = w_i(t) โˆ’ ฮท ยท [ โˆ‡L_local(t) + ฮฒ ยท โˆ‡L_collective(t) ]

Networked Threshold:

ฮธ_net(t) = ฮธ_base + ฮณ ยท Var[ ฮจ_net(t) ]

Global Lyapunov Stability Candidate:

V_net(t) = (1/2) ยท ฮฃ_{i=1}^{N} [ ฮจ_i(t) โˆ’ ฮจ_target ]ยฒ

๐Ÿ“Š Technical Objectives

Objective Technical Description Expected Outcome
Distributed Stability Balance ฮจ state across at least 3 distributed nodes Reduce total entropy variance by > 50%
Networked Transfer Instant transfer of optimal weights [wโ‚, wโ‚‚, wโ‚ƒ] between nodes Reduce adaptation time for new nodes by > 70%
Fault Isolation Isolate nodes exceeding ฮจ_critical 100% protection for remaining network members

๐Ÿ“ˆ Scaling Results

Extended Analysis (N = 20, 30, 50)

Systematic experiments under the scraper regime (800 steps, 4 repetitions per N):

N Variance (mean ยฑ std)
20 0.165380 ยฑ 0.002169
30 0.197713 ยฑ 0.002204
50 0.221481 ยฑ 0.000677

Comparison with Linear Extrapolation

Linear model fitted for N โ‰ค 15: ฯƒยฒ = 0.0101ยทN โˆ’ 0.0331 (Rยฒ = 0.986)

N Linear Prediction Actual Variance Deviation
20 0.1689 0.1654 โˆ’2.1%
30 0.2699 0.1977 โˆ’26.7%
50 0.4719 0.2215 โˆ’53.1%

Key finding: Linear scaling breaks down beyond N โ‰ˆ 20. The system enters a saturation regime where additional nodes contribute progressively less to global variance.

Scaling Curve

    0.25 โ”ค
         โ”‚                                    โ˜… N=50
    0.20 โ”ค                                โ—
         โ”‚                            โ—
         โ”‚                        โ—
    0.15 โ”ค                    โ—
         โ”‚                โ—
         โ”‚            โ—
    0.10 โ”ค        โ—
         โ”‚    โ—
         โ”‚โ—
    0.05 โ”คโ—
         โ”‚
    0.00 โ”ผโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ†’ N
         0    5    10   15   20   25   30   35   40   45   50

         โ—  Empirical data points (mean variance)
         โ”€โ”€  Linear fit (N โ‰ค 15): ฯƒยฒ = 0.0101ยทN โˆ’ 0.0331
         โ”€โ”€  Saturation fit: ฯƒยฒ = 0.228ยท(1 โˆ’ e^{โˆ’N/16.2})
         โ–’   Crossover region (N โ‰ˆ 15โ€“25)

๐Ÿ”ฌ Scaling Regimes

Regime N Range Behavior Description
Linear Accumulation 2 โ€“ 15 ฯƒยฒ โ‰ˆ 0.0101ยทN โˆ’ 0.0331 Near-linear growth, Rยฒ = 0.986
Transition 15 โ€“ 25 Bending toward saturation Crossover zone
Saturation 25 โ€“ 50 ฯƒยฒ โ†’ 0.22 Variance ceiling observed

๐Ÿ“ Proposed Saturation Model

ฯƒยฒ(N) = ฯƒยฒ_max ยท (1 โˆ’ e^{โˆ’N/Nโ‚€})
Parameter Symbol Value Interpretation
Saturation ceiling ฯƒยฒ_max 0.228 Maximum variance asymptote
Characteristic scale Nโ‚€ 16.2 Crossover scale (nodes)
Goodness of fit Rยฒ 0.992 โ€”
Root mean square error RMSE 0.004 โ€”

Asymptotic properties:

  • For small N: ฯƒยฒ โ‰ˆ (ฯƒยฒ_max / Nโ‚€) ยท N โ†’ linear growth
  • For large N: ฯƒยฒ โ†’ ฯƒยฒ_max โ†’ bounded variance

๐Ÿง  Key Scientific Insights

1. No Catastrophic Failure
The system remains stable and operational for all tested configurations (N โ‰ค 50). Variance does not diverge.

2. Intrinsic Self-Regulation
Variance growth is actively constrained by three emergent internal mechanisms:

  • Adaptive aggression auto-tuning (ฮฑ self-adjusts)
  • Collective-AEW weight redistribution
  • Networked threshold elevation (ฮธ_net)

3. Smooth Crossover
The transition from linear growth to saturation is gradual โ€” a soft scaling crossover rather than a sharp phase transition.

4. Bounded Variance Ceiling
The system approaches a natural ceiling ฯƒยฒ โ‰ˆ 0.23, independent of further node addition beyond N โ‰ˆ 30.


๐Ÿš€ Practical Recommendations

Use Case Recommended N Expected Variance Reliability
Production (critical) 2 โ€“ 5 < 0.05 ๐ŸŸข Excellent
Production (standard) 6 โ€“ 12 0.05 โ€“ 0.09 ๐ŸŸข Good
Experimental 13 โ€“ 20 0.09 โ€“ 0.17 ๐ŸŸก Acceptable
Research / Development 21 โ€“ 30 0.17 โ€“ 0.20 ๐Ÿ”ด Degraded
Not recommended > 30 > 0.20 โš ๏ธ Saturated

๐Ÿ“ Project Structure

ENTRO-NET/
โ”‚
โ”œโ”€โ”€ entro_net/                  # Core library
โ”‚   โ”œโ”€โ”€ __init__.py
โ”‚   โ”œโ”€โ”€ psi_sync.py             # ฮจ-Sync protocol
โ”‚   โ”œโ”€โ”€ collective_aew.py       # Collective-AEW optimizer
โ”‚   โ”œโ”€โ”€ net_threshold.py        # ฮธ_net dynamic threshold
โ”‚   โ”œโ”€โ”€ fault_isolation.py      # Cascading failure prevention
โ”‚   โ””โ”€โ”€ simulator.py            # Distributed simulation engine
โ”‚
โ”œโ”€โ”€ bin/                        # Executables
โ”‚   โ””โ”€โ”€ run_simulation.py
โ”‚
โ”œโ”€โ”€ tests/                      # Unit and integration tests
โ”œโ”€โ”€ examples/                   # Usage examples
โ”œโ”€โ”€ scripts/                    # Utility scripts
โ”œโ”€โ”€ docs/                       # Documentation
โ”œโ”€โ”€ results/                    # Simulation outputs
โ””โ”€โ”€ Netlify/                    # Static website

โšก Quick Start

from entro_net import PsiSync, CollectiveAEW, NetThreshold

# Initialize 3-node network
sync       = PsiSync(n_nodes=3)
collective = CollectiveAEW(eta=0.01, target=0.339)
threshold  = NetThreshold(theta_base=1.2)

# Run distributed control loop
for t in range(500):
    psi_states = [node.observe() for node in nodes]

    # Synchronize entropy states across network
    synced_psi = sync.broadcast(psi_states)

    # Collective weight adaptation
    weights = collective.step(synced_psi)

    # Apply global networked threshold
    theta = threshold.update(synced_psi)

    # Isolate faulty nodes if needed
    if sync.detect_fault(psi_states):
        sync.isolate_node(faulty_id)

Reproduce all experiments:

python bin/run_simulation.py \
  --nodes N \
  --steps 800 \
  --regime scraper \
  --repeats 4

๐Ÿ”— Roadmap Integration

Project Code Contribution to ENTRO-NET
ENTROPIA E-LAB-01 Unified Dissipation State Function โ€” foundational entropy formalism
ENTRO-AI E-LAB-02 AI risk monitoring โ€” dynamic entropy threshold design
ENTRO-CORE E-LAB-03 Singular system will โ€” local AEW weight architecture
ENTRO-ENGINE E-LAB-04 Budget distribution between coupled systems
ENTRO-EVO E-LAB-05 Self-learning AEW โ€” 78.1% error reduction baseline
ENTRO-NET E-LAB-06 Collective ฮจ-Sync โ€” distributed stability (this work)

๐Ÿ“š Links & Resources

Resource URL
๐Ÿ“„ Paper (Zenodo) 10.5281/zenodo.19474217
๐Ÿ“‹ OSF Preregistration 10.17605/OSF.IO/9Y7RX
๐Ÿ’ป GitLab gitlab.com/gitdeeper10/ENTRO-NET
๐Ÿ’ป GitHub github.com/gitdeeper10/ENTRO-NET
๐Ÿ’ป Bitbucket bitbucket.org/gitdeeper-10/entro-net
๐Ÿ’ป Codeberg codeberg.org/gitdeeper10/entro-net
๐Ÿ“ฆ PyPI pypi.org/project/entro-net
๐ŸŒ Website entro-net.netlify.app

๐Ÿ“ Citation

@software{baladi2026entronet,
  author    = {Baladi, Samir},
  title     = {ENTRO-NET: Distributed Entropy Synchronization Protocols
               for Collective Neural Networks},
  year      = {2026},
  version   = {1.0.0},
  doi       = {10.5281/zenodo.19474217},
  url       = {https://github.com/gitdeeper10/ENTRO-NET},
  note      = {E-LAB-06. Builds on E-LAB-01 through E-LAB-05.
               EntropyLab Research Program.
               OSF Preregistration: 10.17605/OSF.IO/9Y7RX}
}

๐Ÿ‘ค Author

Samir Baladi
Interdisciplinary AI & Theoretical Physics Researcher
Ronin Institute / Rite of Renaissance


๐Ÿ“„ License

MIT License โ€” see LICENSE file for details.


Part of the EntropyLab ten-project research program ยท E-LAB-06 โœ… Complete

"Intelligence by Design, Stability by Physics, Evolution by Learning, Harmony by Network"

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

entro_net-1.0.0.tar.gz (27.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

entro_net-1.0.0-py3-none-any.whl (14.3 kB view details)

Uploaded Python 3

File details

Details for the file entro_net-1.0.0.tar.gz.

File metadata

  • Download URL: entro_net-1.0.0.tar.gz
  • Upload date:
  • Size: 27.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: ENTRO-NET-Uploader/1.0

File hashes

Hashes for entro_net-1.0.0.tar.gz
Algorithm Hash digest
SHA256 d15621f7bd4f1e433e93e1c001384e70ab584af1661f0f8f926daa01ef4d7066
MD5 5e84338af8422b8fb5c459feee00ac8f
BLAKE2b-256 67adb90142c43600cc49371378a4ae035d7d5f6f56fb5af2dae164287733f490

See more details on using hashes here.

File details

Details for the file entro_net-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: entro_net-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 14.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: ENTRO-NET-Uploader/1.0

File hashes

Hashes for entro_net-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f9744173629b16b53d74c35aa9fa497c7132a931bd3f62bdaac47f22d2b59319
MD5 1312ec82beee2fe23a9432297b180c68
BLAKE2b-256 7b91868dcf17ace5fc83c069a7868e6431ea7949a89d4f5b16cabfccdfdc5ec9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page