GoodWoolf
AI by the People
Foundation Models · Commodity Hardware · Collaborative Training
Website · Docs · Main Repository · Training-Ledger
Building Foundation Models Collaboratively on Commodity Hardware
GoodWoolf builds large foundation models on commodity hardware using the following principles:
-
Open Collaboration: Enable collective model development across independent contributors, coordinated through a shared public training ledger.
-
Virtual Memory Extension: Expanding effective memory beyond physical RAM by leveraging storage-based virtual memory.
-
Data-Independent Scaling: Decoupling total training time from global data volume, bounding system latency to individual run durations rather than aggregate data sizes.
Learn more by following the online documenation:
Project Structure
The project consists of two repositories:
- GoodWoolf (this repository) - the training framework
- GoodWoolf Training Ledger - the public training log
Collaborative Training Workflow
The training process is hardware-agnostic, parallel, and completely asynchronous.
=======================================================
Visual represenation of Collaborative Training Workflow
=======================================================
+-----------+----------+-----------+
| | | |
v | | |
+----------------+ | v |
| Participant A | | +----------------+ |
|----------------| | | Participant B | |
| Local data | | |----------------| |
| Train locally | | | Local data | |
| Publish model | | | Train locally | |
| Pull request | | | Publish model | |
+-------+--------+ | | Pull request | |
| v +--------+-------+ |
| +----------------+ | |
| | Participant C | | |
| |----------------| | |
| | Local data | | |
| | Train locally | | |
| | Model offload | | |
| | Pull request | | |
| +------+---------+ | |
| | | |
v v v |
+-----------------------------+ |
| PUBLIC TRAINING LEDGER |-------+
|-----------------------------|
| Base model weights |
| Training updates / PRs |<------+
| Training history | |
+-----------------------------+ |
| |
v |
+-----------------------------+ |
| Peers / Independent | |
| Auditors |-------+
|-----------------------------|
| Validate and aggregate |
| model updates |
| Publish updated model |
| Pull request |
+-----------------------------+
Usage Examples
Prepare training data
goodwoolf prepare <vendor>/<model> <dataset>
Download model weights
goodwoolf pull <vendor>/<model>
Train model
goodwoolf pretrain <vendor>/<model> <dataset>
Generate text
goodwoolf run <vendor>/<model> --prompt "A long time ago..."
Get involved
GoodWoolf is built by an open-source community project.
Whether you're trainig and sharing models, improving the platform, fixing bugs or writing documentation, your contributions are welcome.
License
- GoodWoolf: MIT
- GoodWoolf Training Ledger: OpenMDW
Metadata
Release files for goodwoolf 0.0.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| goodwoolf-0.0.3.tar.gz | 2.1 MB | Without provenance | Details for goodwoolf-0.0.3.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| goodwoolf-0.0.3-py3-none-any.whl | Python 3 | none | any | Details for goodwoolf-0.0.3-py3-none-any.whl |
Total release size: 4.3 MB
Release files / goodwoolf-0.0.3.tar.gz
| Download URL | goodwoolf-0.0.3.tar.gz |
|---|---|
| Size | 2.1 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
beae3c687f02faa839ebed9582392e9ee42c3339588db99f7a72afb308cc9f96
|
|
BLAKE2b-256 checksum How to use checksums |
08c2327636e088b75be6c9bce29ca0f17414b3f2d20443c888fc54c8d9dcfe40
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / goodwoolf-0.0.3-py3-none-any.whl
| Download URL | goodwoolf-0.0.3-py3-none-any.whl |
|---|---|
| Size | 2.2 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
fe07f2265a4784d3e5aaa03a3b35a9cc70e1f9e0dea80736c023b04792bbe9e0
|
|
BLAKE2b-256 checksum How to use checksums |
2525d6428a3d5e467842518dbf7c78d34bf70666de7d4a69b120ef49be77f2a0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Security for goodwoolf 0.0.3
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.