An Embedded CKIP Rasa NLU Components
Project description
rukip
An Embedded CKIP Rasa NLU Components
Introduction
This open-source library implements Rasa custom components.
It offerstokenizer powered by ckiptagger as condadate in RasaNLU pipeline.
Installation
This library is built on python >= 3.6
pip install rukip
Usage
Download model files
The model files are available on several mirror sites.
You can download and extract to the desired path by the following steps:
- Downloads to
./data.zip - Extracts to
./data/
Add CKIPTokenizer component into rasa nlu pipeline and configure model_path as ./data.
The following is the example Rasa NLU config file
language: "zh"
pipeline:
- name: "rukip.tokenizer.CTBCTokenizer"
model_path: "./data"
recommend_dict_path: ""
cooerce_dict_path: ""
- name: "CountVectorsFeaturizer"
- name: "EmbeddingIntentClassifier"
Components
CKIPTokenizer
This component has one required field (model_path) to be configured and offers two optional fields for user to assign dictionaries.
recommend_dict_pathis the file containing list of user-defined recommended-wordcooerce_dict_pathis the file containing a list of must-word.
The following is the example of user-defined dictionary. Each line shows one pair of word and weight.
土地公 1
土地婆 1
公有 2
來亂的 1
緯來體育台 1
Development
$> git clone git@github.com:circlelychen/rukip.git
$> pip install -r requirements-to-freeze.dev.txt
$> make test
License
licensed under the GNU General Public License v3.0
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
