swarmtorch 0.1.6

Professional PyTorch library for 120+ metaheuristic optimization algorithms (Swarm, Evolutionary, Physics, Hybrid).

SwarmTorch 🐝🔥

The ultimate metaheuristic library for PyTorch

---

SwarmTorch is a high-performance, academic-grade library that brings 120+ metaheuristic algorithms to the PyTorch ecosystem. It enables gradient-free neural network training and state-of-the-art hyperparameter optimization (HPO) with a single, unified API.

Installation • Key Features • Benchmarks & Research • Usage • Citation

---

🚀 Key Features

• 120+ Algorithms: Categorized into Swarm Intelligence, Evolutionary, Physics-based, Human-based, Bio-inspired, and Hybrids.
• Gradient-Free Training: Optimize weights for non-differentiable or complex loss landscapes directly as a PyTorch Optimizer.
• Deep HPO Integration: Replace Random/Grid search with intelligent, nature-inspired exploration.
• Research Ready: Includes full benchmarking suites, raw experimental data, and publication-quality visualizations.
• Highly Optimized: Leverages PyTorch's tensor operations for swarm-level parallelism.

---

📈 Benchmarks & Research

We conducted a massive-scale evaluation of 118 algorithms. Our research shows that 94.9% of SwarmTorch searchers outperform the standard Random Search baseline in HPO tasks.

Detailed performance analysis, convergence plots, and category reliability studies are available in the dedicated benchmarks document:

👉 View Full Research & Benchmarks Report (with Visualizations)

---

📦 Installation

Using pip:

pip install swarmtorch

Using uv (Recommended):

uv add swarmtorch

---

💻 Usage

Model Weight Optimization

import torch.nn as nn
from swarmtorch.swarm.model_training import PSO

model = nn.Sequential(nn.Linear(10, 64), nn.ReLU(), nn.Linear(64, 1))
optimizer = PSO(model.parameters(), swarm_size=30)

def closure():
    optimizer.zero_grad()
    loss = criterion(model(inputs), targets)
    return loss

optimizer.step(closure)

Hyperparameter Tuning

from swarmtorch.swarm.hyperparameter_tuning import PSOSearch

searcher = PSOSearch(
    model_fn=build_model,
    param_space={'lr': (0.001, 0.1), 'hidden_dim': [32, 64]},
    train_fn=train_fn,
    iterations=50
)
best_params = searcher.search()

---

🤝 Acknowledgments & References

This library was developed with reference to the pyMetaheuristic library. We are grateful for their contributions to the metaheuristic optimization community.

📝 Citation

@software{swarmtorch2026,
  author = {Halleluyah Darasimi Oludele},
  title = {SwarmTorch: A PyTorch Library for 120+ Metaheuristic Optimization Algorithms},
  year = {2026},
  url = {https://github.com/hallelx2/swarmtorch}
}