Neural network training and inference framework
Project description
RainbowNeko Engine
Introduction
RainbowNeko Engine is a toolbox for pytorch based neural network training and inference. Multiple tasks and training strategies are built-in and highly expandable.
Install
-
Install pytorch
-
Install from source:
git clone https://github.com/IrisRainbowNeko/RainbowNekoEngine.git
cd RainbowNekoEngine
pip install -e .
# Modified based on this project or start a new project and make initialization
nekoinit
- To use xFormers to reduce VRAM usage and accelerate training:
# use conda
conda install xformers -c xformers
# use pip
pip install xformers>=0.0.17
User guidance
Training
Training scripts based on 🤗 Accelerate or Colossal-AI are provided.
- For 🤗 Accelerate, you may need to configure the environment before launching the scripts.
- For Colossal-AI, you can use torchrun to launch the scripts.
# with Accelerate
neko_train --cfg cfgs/train/cfg_file.yaml
# with Accelerate and only one GPU
neko_train_1gpu --cfg cfgs/train/cfg_file.yaml
Inference
TODO
Tutorials
TODO
Contributing
You are welcome to contribute more models and features to this toolbox!
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
rainbowneko-0.4.tar.gz
(63.2 kB
view details)
Built Distribution
rainbowneko-0.4-py3-none-any.whl
(93.1 kB
view details)
File details
Details for the file rainbowneko-0.4.tar.gz
.
File metadata
- Download URL: rainbowneko-0.4.tar.gz
- Upload date:
- Size: 63.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.20
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 68535de9377710417c78b90dc02f97e7ef7a2a014d3c0753580c7af8f70401cc |
|
MD5 | f3b23b6357b0b3b235224e711ec8500a |
|
BLAKE2b-256 | 7bebc8f70a255ed31a407f3450a3d8fc02a5946d39b37458bf6eb63bd3b03fce |
File details
Details for the file rainbowneko-0.4-py3-none-any.whl
.
File metadata
- Download URL: rainbowneko-0.4-py3-none-any.whl
- Upload date:
- Size: 93.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.9.20
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e5118a0b7d42d6d403bba63f653384ef185e8eee4555771101919815d118febc |
|
MD5 | 0f14728e71c3b8ba57bd0557ee651c57 |
|
BLAKE2b-256 | a40d2b91b9e38bbd1fa1a5ace55f0288899a31c498c37e252b6a13cba77fccaa |