Last released Jun 5, 2025
Package which implements the algorithm proposed by "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".
Last released Mar 15, 2025
Package which implements the algorithm proposed by "BAdam: A Memory Efficient Full Parameter Training Method for Large Language Models".
Supported by
