Skip to main content

Neural network training and inference framework

Project description

RainbowNeko Engine

Introduction

RainbowNeko Engine is a toolbox for pytorch based neural network training and inference. Multiple tasks and training strategies are built-in and highly expandable.

Install

  1. Install pytorch

  2. Install from source:

git clone https://github.com/IrisRainbowNeko/RainbowNekoEngine.git
cd RainbowNekoEngine
pip install -e .
# Modified based on this project or start a new project and make initialization
nekoinit
  1. To use xFormers to reduce VRAM usage and accelerate training:
# use conda
conda install xformers -c xformers

# use pip
pip install xformers>=0.0.17

User guidance

Training

Training scripts based on 🤗 Accelerate or Colossal-AI are provided.

# with Accelerate
neko_train --cfg cfgs/train/cfg_file.yaml
# with Accelerate and only one GPU
neko_train_1gpu --cfg cfgs/train/cfg_file.yaml

Inference

TODO

Tutorials

TODO

Contributing

You are welcome to contribute more models and features to this toolbox!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rainbowneko-0.4.tar.gz (63.2 kB view details)

Uploaded Source

Built Distribution

rainbowneko-0.4-py3-none-any.whl (93.1 kB view details)

Uploaded Python 3

File details

Details for the file rainbowneko-0.4.tar.gz.

File metadata

  • Download URL: rainbowneko-0.4.tar.gz
  • Upload date:
  • Size: 63.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for rainbowneko-0.4.tar.gz
Algorithm Hash digest
SHA256 68535de9377710417c78b90dc02f97e7ef7a2a014d3c0753580c7af8f70401cc
MD5 f3b23b6357b0b3b235224e711ec8500a
BLAKE2b-256 7bebc8f70a255ed31a407f3450a3d8fc02a5946d39b37458bf6eb63bd3b03fce

See more details on using hashes here.

File details

Details for the file rainbowneko-0.4-py3-none-any.whl.

File metadata

  • Download URL: rainbowneko-0.4-py3-none-any.whl
  • Upload date:
  • Size: 93.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.9.20

File hashes

Hashes for rainbowneko-0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 e5118a0b7d42d6d403bba63f653384ef185e8eee4555771101919815d118febc
MD5 0f14728e71c3b8ba57bd0557ee651c57
BLAKE2b-256 a40d2b91b9e38bbd1fa1a5ace55f0288899a31c498c37e252b6a13cba77fccaa

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page