Skip to main content

Turn the laptops in the room into one pool of ML compute. Ad-hoc, zero-config LAN clusters for training and inference on whatever hardware you have.

Project description

onepool

Turn the laptops in the room into one pool of ML compute.

onepool makes any group of computers on the same local network — Windows, Linux, or macOS; NVIDIA, AMD, integrated graphics, or plain CPUs — into a single ad-hoc cluster for machine learning. Not just inference: real distributed training over ordinary WiFi is the headline feature.

pipx install onepool          # every machine, any OS

# machine A — anyone in the room
onepool up                    # start a pool, get a session code

# machines B, C, D
onepool join amber-fox-42     # zero config, auto-discovered

# machine A
onepool train run.yaml        # fine-tune across every machine in the pool
# Ctrl-C → clean teardown. Nothing persists. No accounts. No daemons.

Why

  • Existing tools don't do this. exo (archived) was inference-only and Apple-first. hivemind targets internet-scale volunteer computing. Ray and Horovod need DevOps expertise and homogeneous clusters. Nothing lets a study group pool three mismatched laptops for an evening of fine-tuning.
  • Heterogeneous is the default, not the edge case. A 6GB RTX 3050 and a 4GB GTX 1650 in the same pool, each doing work proportional to what it can actually handle — measured, not assumed.
  • WiFi is enough. Training uses a DiLoCo-style low-communication algorithm (many local steps, rare synchronization of small pseudo-gradients) plus LoRA adapters, so a sync round is megabytes, not gigabytes.
  • Session-based by design. A pool exists while its processes run and vanishes when they stop. Disposable clusters, not infrastructure.

Status

Pre-alpha, built in the open. Roadmap:

Milestone Scope Status
M0 CLI skeleton, hardware probe, onepool doctor ✅ done
M1 Zero-config discovery, join/leave, live dashboard ✅ done
M2 Single-node LoRA fine-tuning path ✅ done
M3 Distributed training (DiLoCo) across mixed hardware over WiFi 🔜 next
M4 Sync compression, rebalancing, first release planned
v0.2 Distributed inference planned

Try it now

git clone https://github.com/one-pool/onepool && cd onepool
uv sync
uv run onepool doctor    # what can this machine contribute to a pool?

onepool doctor detects your GPU(s) and tells you the exact PyTorch install command for your hardware — the one genuinely fiddly step on heterogeneous machines.

Design in one paragraph

Every node runs the same process. mDNS (plus a UDP-broadcast fallback) advertises presence; a human-readable session code carries a shared secret so only invited machines join. The node that submits a job coordinates it: it benchmarks each worker on the actual model, shards data proportional to measured throughput, and runs DiLoCo — each worker takes ~100 local AdamW steps, then the pool all-reduces int8-quantized pseudo-gradients (for LoRA runs, single-digit megabytes) into an outer Nesterov-SGD step. Workers that vanish mid-round are dropped and their shard redistributed; workers that appear are folded in at the next sync. The dashboard is a local web page served by the coordinator.

License

AGPL-3.0-or-later. Use it, fork it, learn from it — but derivatives stay open, including network services built on it. The onepool name and logo are project trademarks; see TRADEMARK.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onepool-0.2.0.tar.gz (290.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

onepool-0.2.0-py3-none-any.whl (45.2 kB view details)

Uploaded Python 3

File details

Details for the file onepool-0.2.0.tar.gz.

File metadata

  • Download URL: onepool-0.2.0.tar.gz
  • Upload date:
  • Size: 290.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onepool-0.2.0.tar.gz
Algorithm Hash digest
SHA256 2bdd202a1c6259767a8bb5c8c43548ce64933238aee7f91a90af9bfaadd3cca9
MD5 149a81ff6b01ae24404d541737d2e279
BLAKE2b-256 c48c4977ac7bc0461b4748cabccdbde7d4aa8a2e7bf5ce1219562f8c31eda865

See more details on using hashes here.

Provenance

The following attestation bundles were made for onepool-0.2.0.tar.gz:

Publisher: release.yml on one-pool/onepool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onepool-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: onepool-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 45.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onepool-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3b7270df05dff424a751a04e7e39e484f6f2bb53062a9d6bcfdf8a845ac1ff07
MD5 daf3b6e0028eade35874b692ad7bad8c
BLAKE2b-256 a5f3ad82cd0f44e41ca644359f8a929e76a48abc9ba65f853d29a77df9d9c2ca

See more details on using hashes here.

Provenance

The following attestation bundles were made for onepool-0.2.0-py3-none-any.whl:

Publisher: release.yml on one-pool/onepool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page