Pre-release
This release is a pre-release and may not be stable for production use.
Epochraft
Supercharge your LLM training with checkpointable data loading.
Key Features
- Checkpointing - Epochraft operates completely deterministically, and allows for a full restoration of state through checkpointing.
- Simple - It's a minimally readable implementation that makes it easy for users to add sources and transforms.
- LLM-Ready - It is equipped out of the box with features necessary for pre-training and SFT of LLMs.
Development
pip install -e .[development]
mypy .; black .; flake8 .; isort .
pytest tests
1 maintainer
Metadata
1 maintainer
Release files for epochraft 0.1.0.dev20230804
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| epochraft-0.1.0.dev20230804.tar.gz | 13.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| epochraft-0.1.0.dev20230804-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 31.5 kB
Release files / epochraft-0.1.0.dev20230804.tar.gz
| Download URL | epochraft-0.1.0.dev20230804.tar.gz |
|---|---|
| Size | 13.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a5be70f6972b48041fee79aff3e72f10bb9704f76e7d01b3fc07b743b53eb07d
|
|
BLAKE2b-256 checksum How to use checksums |
b666fca7ff63743c5717b081434e2162d838274751276e506cdfe96c7bfb3370
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.12
|
Release files / epochraft-0.1.0.dev20230804-py3-none-any.whl
| Download URL | epochraft-0.1.0.dev20230804-py3-none-any.whl |
|---|---|
| Size | 18.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
aacfa3b122b0f9661f6df7fd90d87feed59c9ae509c875972b13b49f1d3ba360
|
|
BLAKE2b-256 checksum How to use checksums |
730e3f396ad1a4491384c1de7b0e817cfb85188596e54098451dbf7c54171f42
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.10.12
|
