18 projects
nanorlhf
nanoRLHF: from-scratch journey into how LLMs and RLHF really work.
kss
A Toolkit for Korean sentence segmentation
stop-sequencer
Implementation of stop sequencer for Huggingface Transformers
python-mecab-kor
Yet another python binding for mecab-ko
pecab
Pure python Korean morpheme analyzer based on Mecab
pydatrie
Pure Python implementation of DARTS (Double ARray Trie System)
oslo-core
OSLO: Open Source framework for Large-scale transformer Optimization
parallelformers
An Efficient Model Parallelization Toolkit for Deployment
krong
KRONG: KoRean language processing toolkit based On Non-neural methods for General purpose
megatron-11b
Megatron LM 11B on Huggingface Transformers
speedformers
asian-bart
Asian language bart models (En, Ja, Ko, Zh, ECJK)
openchat
Opensource chatting framework for generative models
summarizers
opensource text summarization toolkit.
kocrawl
Korean web crawler collections
dialobot
Opensource Multilingual Chatbot Framework
kobart-transformers
Kobart model on huggingface transformers
kochat
Korean opensource chatbot framework
