Skip to main content

Turn the laptops in the room into one pool of ML compute. Ad-hoc, zero-config LAN clusters for training and inference on whatever hardware you have.

Project description

onepool

Turn the laptops in the room into one pool of ML compute.

onepool makes any group of computers on the same local network — Windows, Linux, or macOS; NVIDIA, AMD, integrated graphics, or plain CPUs — into a single ad-hoc cluster for machine learning. Not just inference: real distributed training over ordinary WiFi is the headline feature.

pipx install onepool          # every machine, any OS

# machine A — anyone in the room
onepool up                    # start a pool, get a session code

# machines B, C, D
onepool join amber-fox-42     # zero config, auto-discovered

# machine A
onepool train run.yaml        # fine-tune across every machine in the pool
# Ctrl-C → clean teardown. Nothing persists. No accounts. No daemons.

Why

  • Existing tools don't do this. exo (archived) was inference-only and Apple-first. hivemind targets internet-scale volunteer computing. Ray and Horovod need DevOps expertise and homogeneous clusters. Nothing lets a study group pool three mismatched laptops for an evening of fine-tuning.
  • Heterogeneous is the default, not the edge case. A 6GB RTX 3050 and a 4GB GTX 1650 in the same pool, each doing work proportional to what it can actually handle — measured, not assumed.
  • WiFi is enough. Training uses a DiLoCo-style low-communication algorithm (many local steps, rare synchronization of small pseudo-gradients) plus LoRA adapters, so a sync round is megabytes, not gigabytes.
  • Session-based by design. A pool exists while its processes run and vanishes when they stop. Disposable clusters, not infrastructure.

Status

Pre-alpha, built in the open. Roadmap:

Milestone Scope Status
M0 CLI skeleton, hardware probe, onepool doctor ✅ done
M1 Zero-config discovery, join/leave, live dashboard ✅ done
M2 Single-node LoRA fine-tuning path ✅ done
M3 Distributed training (DiLoCo) across mixed hardware over WiFi ✅ done
M4 Sync compression, rebalancing, first release 🔜 next
v0.2 Distributed inference planned

Try it now

git clone https://github.com/one-pool/onepool && cd onepool
uv sync
uv run onepool doctor    # what can this machine contribute to a pool?

onepool doctor detects your GPU(s) and tells you the exact PyTorch install command for your hardware — the one genuinely fiddly step on heterogeneous machines.

Design in one paragraph

Every node runs the same process. mDNS (plus a UDP-broadcast fallback) advertises presence; a human-readable session code carries a shared secret so only invited machines join. The node that submits a job coordinates it: it benchmarks each worker on the actual model, shards data proportional to measured throughput, and runs DiLoCo — each worker takes ~100 local AdamW steps, then the pool all-reduces int8-quantized pseudo-gradients (for LoRA runs, single-digit megabytes) into an outer Nesterov-SGD step. Workers that vanish mid-round are dropped and their shard redistributed; workers that appear are folded in at the next sync. The dashboard is a local web page served by the coordinator.

License

AGPL-3.0-or-later. Use it, fork it, learn from it — but derivatives stay open, including network services built on it. The onepool name and logo are project trademarks; see TRADEMARK.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

onepool-0.3.0.tar.gz (297.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

onepool-0.3.0-py3-none-any.whl (52.8 kB view details)

Uploaded Python 3

File details

Details for the file onepool-0.3.0.tar.gz.

File metadata

  • Download URL: onepool-0.3.0.tar.gz
  • Upload date:
  • Size: 297.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onepool-0.3.0.tar.gz
Algorithm Hash digest
SHA256 3cf3cae731579fbc87dbac46574096c922c472677e176ceb25cf2e1def0085b8
MD5 7660f42b53b3d9a220507011bc96e908
BLAKE2b-256 39728bb00d32e4307775cccfa91aa21aa0ac583b4322390ae678c31e49bde60f

See more details on using hashes here.

Provenance

The following attestation bundles were made for onepool-0.3.0.tar.gz:

Publisher: release.yml on one-pool/onepool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file onepool-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: onepool-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 52.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for onepool-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c32ff8050cc1fe72352e383dc45536060838570a6314825d8a02c8fbb71b0339
MD5 c0cbda5cbbb9552675698ab769c8a8b4
BLAKE2b-256 8e0ea31cd76cbd434257aa15ae487f18b8f10af704cbf7349af8ab149739e0eb

See more details on using hashes here.

Provenance

The following attestation bundles were made for onepool-0.3.0-py3-none-any.whl:

Publisher: release.yml on one-pool/onepool

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page