Skip to main content

GigaTrain

An Efficient and Scalable Training Framework for AI Models

| Quick Start | Contributing | License | Citation |

✨ Introduction

GigaTrain is an efficient and scalable training framework engineered to accelerate the development of large AI models. It provides optimized performance and streamlined training workflows, allowing researchers and developers to easily experiment with various models.

Major features
  • 🔍 Unified distributed training: Seamless multi-GPU/multi-node execution; supports DeepSpeed ZeRO (0/1/2/3), FSDP/FSDP2, DDP, etc.
  • 🔧 Flexible and reproducible configs: Clean PY/YAML/JSON configuration and a registry-driven, modular design with pluggable optimizers, schedulers, samplers, transforms, etc.
  • 📈 Performance and memory efficiency: Mixed precision (FP16/BF16/FP8), gradient accumulation, gradient checkpointing, EMA, etc.
  • 📊 Built-in monitoring and checkpointing: Integrated experiment logging and robust checkpointing for reliable long runs and resumability.
  • Lightweight and Easy to Use: Simple pip/source install; developers can focus solely on implementing the key algorithm, as the framework handles repetitive, tedious, and error-prone things like backprop, logging, checkpointing, resuming, EMA, and multi-node/multi-GPU execution.

⚡ Installation

GigaTrain can be installed from PyPi and has to be installed in a virtual environment (venv or conda for instance):

pip3 install giga-train

or you can install directly from source for the latest updates:

conda create -n giga_train python=3.11.10
conda activate giga_train
git clone https://github.com/open-gigaai/giga-train.git
cd giga-train
pip3 install -e .

🚀 Getting Started

  • We provide a step-by-step example to teach you how to fine-tune a model using GigaTrain.
  • Refer to projects for more examples.

🤝 Contributing

We welcome contributions! Please see our Contributing Guide for details.

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

📖 Citation

@misc{gigaai2025gigatrain,
    author = {GigaAI},
    title = {GigaTrain: An Efficient and Scalable Training Framework for AI Models},
    year = {2025},
    publisher = {GitHub},
    journal = {GitHub repository},
    howpublished = {\url{https://github.com/open-gigaai/giga-train}}
}

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

giga_train-1.1.0.tar.gz (47.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

giga_train-1.1.0-py3-none-any.whl (58.4 kB view details)

Uploaded Python 3

File details

Details for the file giga_train-1.1.0.tar.gz.

File metadata

  • Download URL: giga_train-1.1.0.tar.gz
  • Upload date:
  • Size: 47.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.10

File hashes

Hashes for giga_train-1.1.0.tar.gz
Algorithm Hash digest
SHA256 774e28d41d9e8bb5edb43c5e768881938dc470cc5ad5615c6e79487588137ff5
MD5 5b723709ba15f13e2b1605f500508ac4
BLAKE2b-256 83c5f043f0d893e2d6203f9b7ec7663ee89185e5c638ae03441e8ee744bd0d0b

See more details on using hashes here.

File details

Details for the file giga_train-1.1.0-py3-none-any.whl.

File metadata

  • Download URL: giga_train-1.1.0-py3-none-any.whl
  • Upload date:
  • Size: 58.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.10

File hashes

Hashes for giga_train-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 14c201b3df70bdf205c0f4ff036158521b6bf5fffe93ce2a8e679e08c4fbddc8
MD5 9aebbbbf16a082aa042f4ff4bfc64aed
BLAKE2b-256 aece5db49d091cccefa21e3ca1585e185ec59e1f3c5002eea8b80b5633eeb8ed

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

1.1.0 This release

2 files

1.0.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page