A fast gradient checkpointing strategy for training with memory-efficient attention (e.g., FlashAttention).

These details have not been verified by PyPI

Project description

FastCkpt: fast gradient checkpoint for training with FlashAttention

This is a test repo in development.

These details have not been verified by PyPI

0.0.4

Oct 9, 2023

0.0.3

Oct 4, 2023

This version

0.0.2

Oct 4, 2023

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Oct 4, 2023 Source

Uploaded Oct 4, 2023 Python 3

Hashes for fastckpt-0.0.2.tar.gz
Algorithm	Hash digest
SHA256	`a59c703b663af887105e82934cc0e0a4089cc2a3dc82e601d1958ca9e42df4da`
MD5	`5b56977fc428a32c1d660e923af99a06`
BLAKE2b-256	`f5d74af71f4e176b8f614bf8c7296c968918668caaeb4aa42b04bdc1c9de9245`

Hashes for fastckpt-0.0.2-py3-none-any.whl
Algorithm	Hash digest
SHA256	`38b924a770b27e54aacff0ae5f51ea558c60ac8674b27e8f1a06a3f9099e3d33`
MD5	`39788b633ca85500e33f4ccc5c944f66`
BLAKE2b-256	`7f39da3f160858c81c246e257732fed124f8ce244f7dc97dad3a66940c49070a`