tfds-korean 0.0.1a3

A collection of Korean Text Datasets ready to use using Tensorflow-Datasets.

tfds-korean

A collection of Korean Text Datasets ready to use using Tensorflow-Datasets.

documentation | pypi

Usage

Installation

pip install tfds-korean

Loading dataset

import tensorflow_datasets as tfds
import tfds_korean.nsmc # register nsmc dataset

ds = tfds.load('nsmc')

train_ds = ds['train'].batch(32)
test_ds = ds['test'].batch(128)

# define model
# ....
# ....

model.fit(train_ds)
model.evaluate(test_ds)

Licenses

The license for this repository and licenses for datasets are applied separately. It is recommended to use each dataset after checking the dataset's website.