Skip to main content

GoodWoolf

GoodWoolf

AI by the People

Foundation Models · Commodity Hardware · Collaborative Training

Website  ·  Docs  ·  Main Repository  ·  Training-Ledger


Building Foundation Models Collaboratively on Commodity Hardware

GoodWoolf builds large foundation models on commodity hardware using the following principles:

  • Open Collaboration. Enable collective model development across independent contributors, coordinated through a shared public training ledger.

  • Virtual Memory Extension: Expanding effective memory beyond physical RAM by leveraging storage-based virtual memory.

  • Data-Independent Scaling: Decoupling total training time from global data volume, bounding system latency to individual run durations rather than aggregate data sizes.

Learn more by following the online documenation:

Project Structure

The project consists of two repositories:

Collaborative Training Workflow

The training process is hardware-agnostic, parallel, and completely asynchronous.

=======================================================
Visual represenation of Collaborative Training Workflow
=======================================================

          +-----------+----------+-----------+
          |           |          |           |
          v           |          |           |
  +----------------+  |          v           |
  | Participant A  |  |  +----------------+  |
  |----------------|  |  | Participant B  |  |
  | Local data     |  |  |----------------|  |
  | Train locally  |  |  | Local data     |  |
  | Publish model  |  |  | Train locally  |  |
  | Pull request   |  |  | Publish model  |  |
  +-------+--------+  |  | Pull request   |  |
          |           v  +--------+-------+  |
          |   +----------------+  |          |
          |   | Participant C  |  |          |
          |   |----------------|  |          |
          |   | Local data     |  |          |
          |   | Train locally  |  |          |
          |   | Model offload  |  |          |
          |   | Pull request   |  |          |
          |   +------+---------+  |          |
          |          |            |          |
          v          v            v          |
       +-----------------------------+       |
       |   PUBLIC TRAINING LEDGER    |-------+
       |-----------------------------|
       | Base model weights          |
       | Training updates / PRs      |<------+
       | Training history            |       |
       +-----------------------------+       |
                     |                       |
                     v                       |
       +-----------------------------+       |
       |   Peers / Independent       |       |
       |   Auditors                  |-------+
       |-----------------------------|
       | Validate and aggregate      |
       | model updates               |
       | Publish updated model       |
       | Pull request                |
       +-----------------------------+

Usage Examples

Prepare training data

goodwoolf prepare <vendor>/<model> <dataset>

Download model weights

goodwoolf pull <vendor>/<model>

Train model

goodwoolf pretrain <vendor>/<model> <dataset>

Generate text

goodwoolf run <vendor>/<model> --prompt "A long time ago..."

Get involved

GoodWoolf is built by an open-source community project.

Whether you're trainig and sharing models, improving the platform, fixing bugs or writing documentation, your contributions are welcome.

License

Metadata

Release files for goodwoolf 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for goodwoolf 0.0.2
File Size Uploaded Provenance Actions
goodwoolf-0.0.2.tar.gz 2.1 MB Without provenance Details for goodwoolf-0.0.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for goodwoolf 0.0.2
File Interpreter ABI Platform Actions
goodwoolf-0.0.2-py3-none-any.whl Python 3 none any Details for goodwoolf-0.0.2-py3-none-any.whl

Total release size: 4.3 MB

Release files / goodwoolf-0.0.2.tar.gz

Download URL goodwoolf-0.0.2.tar.gz
Size 2.1 MB
Tags Source
SHA-256 checksum
How to use checksums
8ab329b404c9ee3c3d5f74297a09e16f7b407ee101ade73b00bf334115fb9256
BLAKE2b-256 checksum
How to use checksums
1ed7d06541291495c6cfdc9e1f05cbb64c382a30cc567ed6a9e86c38f6fe2ffa
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / goodwoolf-0.0.2-py3-none-any.whl

Download URL goodwoolf-0.0.2-py3-none-any.whl
Size 2.2 MB
Tags Python 3
SHA-256 checksum
How to use checksums
8642b57a845672992f5989b3a69b835890495dd4191f931c5f60a234e3ee3752
BLAKE2b-256 checksum
How to use checksums
3dc438321c25cbaddfd10a889e83c9a5621d99d2b4002c416f2d1af85ff7e142
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for goodwoolf 0.0.2

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page