Tiny DSL to generate training dataset for NLU engines
Project description
Tiny DSL to generate training dataset for NLU engines. Based on the javascript implementation of chatl.
Installation
pip
$ pip install pychatl
source
$ git clone https://github.com/atlassistant/pychatl.git
$ cd pychatl
$ python setup.py install
or
$ pip install -e .
Usage
From the terminal
$ pychatl .\example\forecast.dsl .\example\lights.dsl -a snips -o '{ \"language\": \"en\" }'
From the code
from pychatl import parse
result = parse("""
# pychatl is really easy to understand.
#
# You can defines:
# - Intents
# - Entities (with or without variants)
# - Synonyms
# - Comments (only at the top level)
# Inside an intent, you got training data.
# Training data can refer to one or more entities and/or synonyms, they will be used
# by generators to generate all possible permutations and training samples.
%[my_intent]
~[greet] some training data @[date]
another training data that uses an @[entity] at @[date#with_variant]
~[greet]
hi
hello
# Entities contains available samples and could refer to a synonym.
@[entity]
some value
other value
~[a synonym]
# Synonyms contains only raw values
~[a synonym]
possible synonym
another one
# Entities and intents can define arbitrary properties that will be made available
# to generators.
# For snips, `type` and `extensible` are used for example.
@[date](type=snips/datetime)
tomorrow
today
# Variants is used only to generate training sample with specific values that should
# maps to the same entity name, here `date`. Props will be merged with the root entity.
@[date#with_variant]
the end of the day
nine o clock
twenty past five
""")
Testing
$ cd tests/
$ python -m unittest -v
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pychatl-1.1.0.tar.gz
(5.7 kB
view details)
File details
Details for the file pychatl-1.1.0.tar.gz
.
File metadata
- Download URL: pychatl-1.1.0.tar.gz
- Upload date:
- Size: 5.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.19.6 CPython/3.6.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 912a56dc27f805b020755d6a0ae149bf48cd1bc8852e5ed5f1f390b8b4e5ba2a |
|
MD5 | dff80a43300983f9630c490c3743241f |
|
BLAKE2b-256 | 2848197651aa831543a4c93b06e8b5065c5dca7c2e4bfe7ed6b0455f7ce51c58 |