Skip to main content

progresspals

Private AI clusters pooled over the internet, on your hardware. No VPS, no API fees.

ProgressPals lets a small group of trusted people pool their GPUs and run massive open-source language models that no single machine could host on its own. One CLI, one invite link, one local OpenAI-compatible endpoint.

Install

pip install progresspals

Requires Python 3.10+ on Linux or macOS. Windows is supported via WSL2.

Quick start

# 1. Authenticate (one-time)
pals init

# 2. Start a new private swarm
pals create Qwen/Qwen3-32B

# 3. Mint an invite for a teammate
pals invite create

# 4. They join with one command
pals join Qwen/Qwen3-32B <invite-token>

# 5. Expose an OpenAI-compatible endpoint at localhost:8080
pals serve

Then point Cursor, Aider, Continue, n8n, the OpenAI SDK, or anything that speaks /v1/chat/completions at http://localhost:8080/v1.

Supported models

Pass any of these HuggingFace model IDs directly to pals create:

Family Sizes
Qwen 3 0.6B, 1.7B, 4B, 8B, 14B, 32B (dense), 30B-A3B, 235B-A22B (MoE)
Qwen 3-Coder 30B-A3B, 480B-A35B
Qwen 2.5 0.5B, 1.5B, 3B, 7B, 14B, 32B, 72B
Qwen 2.5-Coder 0.5B, 1.5B, 3B, 7B, 14B, 32B
Llama 2 / 3 / 3.1 / 3.3 up to 405B
Mixtral 8x7B, 8x22B
Falcon 40B, 180B
BLOOM 176B

How it works

The model is split across machines. Each peer holds a slice of the transformer layers. Inputs flow through the chain one peer at a time and stream back. Pipeline parallelism over libp2p, with per-swarm AES-256-GCM encryption on activation tensors between peers.

Swarms are invite-only. No public discovery, no leaderboard, no telemetry. Membership lives as a per-swarm allow-list and is enforced server-side every ~30 seconds.

What's inside

  • Pipeline-parallel distributed inference for 8 model families
  • libp2p peer discovery + NAT traversal
  • Per-swarm AES-256-GCM activation encryption with HKDF-SHA256 key derivation
  • Single-use, regenerable invite tokens
  • Live peer dashboard (pals dash) — TUI with peer health, layer coverage, RPC stats
  • OpenAI-compatible HTTP server (pals serve) — /v1/chat/completions, /v1/models, SSE streaming
  • Member controls (pals peers list / kick, pals invite list / revoke)
  • Optional INT8 / NF4 quantization via bitsandbytes for smaller VRAM footprints

License

Apache License 2.0. See LICENSE and NOTICE for full text and attributions.

Links

Metadata

Release files for progresspals 0.1.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for progresspals 0.1.2
File Size Uploaded Provenance Actions
progresspals-0.1.2.tar.gz 209.3 kB With provenance Details for progresspals-0.1.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for progresspals 0.1.2
File Interpreter ABI Platform Actions
progresspals-0.1.2-py3-none-any.whl Python 3 none any Details for progresspals-0.1.2-py3-none-any.whl

Total release size: 460.2 kB

Release files / progresspals-0.1.2.tar.gz

Download URL progresspals-0.1.2.tar.gz
Size 209.3 kB
Tags Source
SHA-256 checksum
How to use checksums
adeff07b268fd92d6583f2dc0766ee4768039abd18a011f3938140e588b971d1
BLAKE2b-256 checksum
How to use checksums
4805a8f88794ef7a30f8a3a13974a8f080c0dbbb4e4fee6c938e4f39ce149090
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 19, 2026.

Transparency log

Release files / progresspals-0.1.2-py3-none-any.whl

Download URL progresspals-0.1.2-py3-none-any.whl
Size 250.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0dbb048d530770979ca24cd98db547b2bb841dceef04d4e88cf5f9f8171aff31
BLAKE2b-256 checksum
How to use checksums
2c04a59749aeea931cb8c8b659589b3ad899782cd2b4c6df0f456b15f3d8d708
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.13.12

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 19, 2026.

Transparency log

Security for progresspals 0.1.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

All 2 files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for progresspals-0.1.2.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on May 19, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.2 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page