Neural network training and inference framework
Project description
RainbowNeko Engine
Introduction
RainbowNeko Engine is a toolbox for pytorch based neural network training and inference. Multiple tasks and training strategies are built-in and highly expandable.
Install
-
Install pytorch
-
Install from source:
git clone https://github.com/IrisRainbowNeko/RainbowNekoEngine.git
cd RainbowNekoEngine
pip install -e .
# Modified based on this project or start a new project and make initialization
nekoinit
- To use xFormers to reduce VRAM usage and accelerate training:
# use conda
conda install xformers -c xformers
# use pip
pip install xformers>=0.0.17
User guidance
Training
Training scripts based on 🤗 Accelerate or Colossal-AI are provided.
- For 🤗 Accelerate, you may need to configure the environment before launching the scripts.
- For Colossal-AI, you can use torchrun to launch the scripts.
# with Accelerate
neko_train --cfg cfgs/train/cfg_file.yaml
# with Accelerate and only one GPU
neko_train_1gpu --cfg cfgs/train/cfg_file.yaml
Inference
TODO
Tutorials
TODO
Contributing
You are welcome to contribute more models and features to this toolbox!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
rainbowneko-0.4.tar.gz
(63.2 kB
view hashes)
Built Distribution
rainbowneko-0.4-py3-none-any.whl
(93.1 kB
view hashes)
Close
Hashes for rainbowneko-0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e5118a0b7d42d6d403bba63f653384ef185e8eee4555771101919815d118febc |
|
MD5 | 0f14728e71c3b8ba57bd0557ee651c57 |
|
BLAKE2b-256 | a40d2b91b9e38bbd1fa1a5ace55f0288899a31c498c37e252b6a13cba77fccaa |